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ABSTRACT 


The data flow concept of computation seeks to achieve high performance by allowing 
concurrent execution of instructions based on the availability of data. This thesis explores the 
translation of a subset of the high level language VAL to data flow graphs. The major problem in 
performing this translation for the target machine, the Dennis-Misunas data flow computer, stems from 
the restriction that graph execution sequences place at most one value on any given arc at any time. 
The data/acknowledge are pair transformation is introduced as a means of implementing this required 
operational behavior. Its effect on data flow graph operation is subsequently explored as it relates to 
correctness and performance. , 


Though the arc transformation enables graphs to be executed without the possibility of 
deadlock, the resulting overhead and the potential loss of some concurrency represent significant costs. 
Two techniques aimed at minimizing these problems are developed for optimizing transformed graphs. 
The optimization to climinate unneeded acknowledge arcs analyzes VAL constructs to identify arc pairs 
which may permit removal of their acknowledge arc. ‘The optimization to balance token flow specifies a 
method of inserting identity operators into a graph for the purpose of pipelining input sets, and thereby 
increasing graph throughput. ‘Though developed within the context noted, the translation and 
optimization issues described should prove applicable to other data flow architectures. 
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-CHAPTER ONE 
1.1 Introduction 


The short history of computing as a‘science is unique in its unparalicied rate of technological 


Beart 
te OED | 


growth. In response to this, the demand for greater levels of computing power has risen as rapidly. 
Anticipating the continuation of this trend, rescarch in the area of arate computation seeks to achieve 
high performance by. manipulating programs to’ cxploit the ‘parallclism inherent in many problems. 
‘Though this has led to the introduction of "do in parallel” constructs within certain languages, the 
sequential nature of conventional-machine programming: has proved to be a barrier to the formulation 
of an adequate and practical approach. The data flowconeepvof computation overcomes this difficulty 
by allowing the availability of data to determine the exccution sequence, rather than a sequential 
instruction counter: - In:the data flow:model, an‘opcration is‘executed as sodn'as its required operands 
have been computed. ‘The development of this concept has reseed ‘in the proposil of several data flow 
machine’ architectures and associated: data flow languages. ‘This thesis addresses certain language 
translation problems which afise in ‘translating the high level: data flow language, VAt{2] for the 
Dennis-Misunas data flow machinef?1]. 

The concept of data flow is best illustrated: by data flow graphs which explicitly show the data 
dependencies of operations in a data flow program. The operators and ares of data flow graphs are 
viewed as an abstraction of the instruction cells and operand registers of the data flow machine and as 
such, provide a model for describing translation problems. The chapter proceeds with a more detailed 
look at the components and operation of data flow graphs, followed by a bricf look at the high level 
data flow language; VAL and its translation into graph form. The major problem, termed safely, which 


arises in making the translation will be identified and discussed in ‘section 1.4. While resolving: the 


safety issuc is straightforward, the solution introdutes a secondary, more subtle sct of problems to the 
graphs. Section 1.5 identifies these along with sevcral optimizations of the initial solution aimed at 
minimizing such problems, an expanded discussion of which forms a major portion of this thesis. The 


chapter concludes with a synopsis of the remainder of the thesis, 
1.2 Data Flow Graph Operation 


The basic components of directed data flow.graphs. are operators and arcs which join the 
operators, . When an. operator fires, it absorbs values or. 4okeus-from its input arcs and produces tokens 
on its output arcs, ‘These are three aperator types; and corecsponding rules defining theit opcration or 
firing behavior..’Phe graph in-Figure 1.4.whick represents the: VAI -conditéanal.construct: 

if exp then felse g | 
contains instances of cach type. ‘The exp nede is an abbreviation fer.a VAL expression representing the 
predicate of the conditional. hus, it skeuld evalpate to a boolean value. 90 00- 

‘The most generalized operator type is the fictional operator. represcnied in the figure by 
nodes f and g. ‘Vhese sperators may perform simple: arithmetic: operations such as addition or 
multiplication, or more complex functions such as square root. ‘he fisiag. behavior rule for functional: 
operators specifics that a token be present on each input arc for the operator to fire, at which time all 
inputs arc absorbed, the appropriate function is computed and a rcsuit token is produced on cach of the 
operator's output arcs. 

_ The ini and false contro} gates represented in Figure 1.1 by the T; and-F nodes form.a eond 
operator type. Fach of these operators requires a.control and a:data input. to--fire, and operates 
according to the following rule: If the control input matches the gate type, the data-input is transmitted 


to the gate’s output arc, otherwise the input data token is absorbed and ne output is produced. Thus, a 


Figure 1.1. Data flow graph of the VAL expression “if exp then // else g 


inl in2 in3 


Spal ch = 


‘T gate (F gate) will transmit its input data token to its output arc if and only if it receives a true (false) 
input control token. 
e 


The remaining operator type is the M a or morse control gale which i three inputs; a 


control.input, and two data inputs corresponding to cine and fie control sigal values. To fire, an M 


Laem | 
i 


wa peaulres an a control token and corresponding api data token bhi is then sranamitted to 
the galc’s output arc. A value present on the input data arc not selected is ; unaffected by the gate’s 
one Aopropialely: the M gate merges two pas in the raph ‘Thus, Figur 1.1 models the 
condidoaal construct behavior by allowing an input token to daw through cidher the T or iF gale, (based 
on the @alaadon of exp), to the M gate which merges the truc and false viaih to Kaadive arcsult token . 


on the graph output port. 


1.3 Translation of VAL to Data ‘Flow Graphs: 


While tat flow: graphs expose concurrency inherent in a Smputetion by explicit 
representation of operator dependencies, it is impractical to a ea Pern in this form. Instead, we 
introduce the high level data flow language VAL, acranym for ralye-rienied algorithmic language, and 
a translation algorithm mapping VAL programs into data flow graphs. Developed by Ackerman and 
Dennis{2] as a source language for data flow graphs, VAL. is; an applicative tnienage containing 
constructs well suited for expressing: parallelism in a'program. A’ RNF scilicaibn of the syntax of a 
subset of VAL, used in the development of this thesis follows. ; | 

exp ::= id| const | exp, exp| oper(exp) | let idlist = expin exp| 

if exp then exp else exp | for idlist = exp do iterbody 


iterbody :: = exp.| iter exp | let idlis! = exp in iterbody| 
if Ur sain Menon else eee: 


. aes | “programming uneiae idemifiers” 

idlist ::= id {, id} 

ear ::= “programming language constants” 

oper :.= se maaite meas operators” 

The recursive translation algorithm mapping VaL crprcssors into their ines flow graph 
Sapiro manOns, defined by J. D. Brock[3], consists of the functions T and T, which jesneclivels map 
VAL expressions and itcration bodics into their ech implementations Both functions produce graphs 
which have an input port for cach free variable i in on a abiratt or itcration n body vere translated. 
Tfexp] has an output port for each value returned by the expression: 5 Tylierbo has two sets of 
output ports, I and R, used respectively to re-iterate or return a set of values, and an output port ifer? to 


signal which possibility has occurred. Translations of the conditional and iteration expressions are used 
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extensively _ this thesis, and are shown in Figures 1.2 and 4:3 respectively. ° 

Functioning of the conditional expression.in Figure 1.2 should be clear sri the discussion of 
Figure 1.1. Evaluation of Tlexp,] should produce an input control value for all gates in the graph, 
allowing tokens to flow through either the T or F Bates, cnabling computation of the graph represented 
by TLexpy] or Texp,] respectively. ‘The tration expression of igure 1.3 is formed by using M gates 
to merge the values resulting from evaluation of ou, with the iteration, I, outputs of T Literbody]. The 
control input port of cach M gate is connected tothe iter? oat of T Literbods], initialized with a 
false token to ensure that selection of the first set of data Higa | is from Tlexp]. A set of data values 
, will be iterated as long as successive iter? ails. are {ruc and will be returned at the first instance of a 
false iter? output, which reinitializes the M gates. A more detailed explanation of the application of the 


translation algorithm to dre conditional and iteration expressions, as well as to the remaining 


expressions specified in the VAL. subset defined above, can be found in [3}. 


Figure 1.2. T[if exp then exp, else exp; end] 


-li- 


Figure 1.3. T[for idlist = exp do iterbody end] 


A major concern in gencrating data flow graph impletnentations of VAI. expressions is ensuring 


correct modelling of the semantics of each high level constrict. ‘In fact. the teseslial aaoetiet is part 
of a two step process giving the operational semantics for ie VAL subst ‘The pen semantics oid | 
a data flow program is a formal modelling of the execution of the program's data flow crag “The 
operators composing data flow graphs are determinate, meaning that every complete set of inputs to an 
operator (one for cach input port) produces a unique set af stipe Patif[25] proved that if the 
operators of a graph are determinate, the graph itself is determinate. Developing operational semantics 
for VAL is possible duc to the determinate nature of its Cospontiae ae flow graphs. Thus, a 
complete sct of i inputs to a data flow on will produce a unique set of outputs making it necessary to 
examine fa one execution sequence of a graph to derive the result of its execution. The graphs in this | 
thesis are generated from Brock’s translation algorithm and: are therefore assumed to be correct 


semantic representations based on the operational semantics developed in [3]. 
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1.4 Safety Transformations for Data Flow Graphs. 


Aneugh we ¢ accep the data flow graphs gerd by the tanstation algorithm discussed in the 
PICVIOUS:s section as theoretically correct, their arcs are assumed to be infinite aNeUES: -- this prevents 
their realization. While i it oe be pices to implement the ph using sufficiently large finite 
buffers, this solution may not be acceptable. To examine the problem, consider t the state of sig praph 
shown in Figure 1 A The token aati shown can = reached by asuming that the eraph occurs 
within an itcration construct which recycles the putput of the const. T The second s set of input avai 
could therefore have been Saree in Response to the output resuing from the first set of inputs. 
Assuming that the output of this first set was panded by popes meee through the false — 
of the aan it would be ean for the Ree reeont T ane inputs aah belied he to still be 
present when the second sct of tokens arrives, creating the computition state reer 


pac 
ih a 


Figure 1.4. Unsafe token configuration resulting from infinite queue arcs 


inl Sin? ind 
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While an implementation of graph arcs. as~buffers of some constant sizc {greater ‘than one) 
could accommodate this configuration, the aesas of a number of mans sed arcbiertures including that 
of the Dennis- Misunas data flow machine, cannot mepport this: The correspondence of graph arcs to 
aisehine registers in such designs makes it ¢ necessary to » consider cron those execution scauenes which 
phe at at most one token on any given arc al any y time. in the Dennis-Misunas es flow wiachiite: the 
consequences of 9 placing more d than one token on ane arc or 2 coespondingy, computing a sx successive 
‘esiuce valu bctore it can be ored arc possible sondeternsiatan: and deadlock asa result ey values 
queueing t up in its distribution network and ‘Shécklng ane vlogs es reaching their destinations 
ene the onc- sake operanonl, requirement ie pcventing data flow operators from 
producing new token until their output a emp. This be Rear is achieved by defining the 
following firing rule for all raph operator: —— os 7 : | 


Operator Firing Rule: An operator is enabled to fire when all of its necded inputs are 
present and all of its output arcs are empty. 


at, at LEYTE ERR Pesset pie 


Application of this rule prevents the Figure 1 As State from occurring. 

While the operator firing rule defines the desired: ‘oken behavior, the problem of 
implementation remains. By performing ; a maSonape which replaces each arc of a data flow graph 
by an appropriate data/acknowledge arc pair (d/a, are pair the graph’ s infinite queucs are replaced by 
buffers of capacity one, and the cpr fring rule i is sexptily built into the graph. This is illustrated 
in Figure 1.5, which shows the Hanstormes conditional construct of Figure 1.4. The transformation 
creates arc pairs which hold cither a data or acknowledge token, where the later indicates that its 
corresponding data arc is empty. With the addition of acknowledge arcs and tokens, firing rules revert 
to their original specifications which depend: onty: ‘on the peat of tokens on input, including 


acknowledge, arcs: The operator firing rule requirement that output arcs be empty is ensured by the . 
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Figure 1.5. ‘Transformed Figure 1.4. 


@ = data token 
QO ack. token 
a ® data are. 
——-~> ack. arc 


enabling condition that ack nowiedge inputs be present 


The keyword used in oe this transformation is safely, where ure underlying i idea and 


hie La netge ne.» ee Eas 


the scrninoley is siecilé in Petri net theory. ‘Chipier 2 discusses ag analogy b between data flow eraphs 
and Petri nets, and the influence of Petri net theory on the safes inseam Included in the same 
chapter is a more detailed description of the transformation, and a consideration: of its effect onthe . 


correctness of graphs. 
1.5 Optimizing Transformed Data Flow Graphs : 


While the ‘aietormation of data arcs to d/a arc pairs Sables the eapenenalan of data flow 
siaplie: it is imperative to question the cost of the weinowledeine eles ane determine the 
- inefficiencies, if any, that are introduced. In fact, there is much to say concerning jie issues. Aside 


from the obvious overhead involved in incorporating acknowledge arcs and tokens, the constraints 
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which they impose on graph operation may cause bottlenecks. In response to this, -we have developed 
optimization techniques which focus on decreasing overhead and increasing graph throughput. The 
optimization to eliminate unneeded acknowledge ares is aimed at decreasing overhead, thereby reducing 
the cost of the sorarimnation scheme. An analysis of data ow graphs of VAL constructs indicates that 
the cffect of certain acknowledge arcs arc realized. by the graph's qpatrol structure, making the arcs 
unnecessary. On the other hand, increasing throughput, the-gial of the Optimization to balance token 
flow, is accomplished by introducing additional identity actors ino the mt and consequently creating 
more d/a arc pairs. ve ce . | 

Note that though the: term “optimization” may este ona yaricty; of meanings, our use of the 
word is confined to the d/a a6 pair transformation desribed above: Both optimizations consider the 
number of acknowledges tied th data flow graph saree We do not. consider program dependent 


optimizations which might typically involve modification of a | wraph’s » structure, i.e., removal of 


annerenaty data ‘arcs or seine This later form of optimization is s analogous to standard 


Mess Dl. at 


optimization sschniguks for conventional sequent programs sail though ae yet ally explored, . 


should prove readily adaptable to data flow. 
1.6 Structure of Thesis 


Having established a foundation, we proceed to consider the main tasks identified Chapter 2 
expands on the safety transformation introduced in-:soction: 1.4; and: discusses elated: rélovane theory. 
Chapters 3 and 4 respectively contain a development of the a to palanice token flow, and 
climinate unneeded acknowledge arcs. “Conelanions arc presented i in chapter 5 slong with sungested 


areas for future research. 
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i CIIAPTER FWQ | 
2.1 The Safety Transformation | 


The aim of the: data/acknowledge arc pair transformation of data flow programs is to 
implement the operator firing behavior, defined in chapter 1, and restated haere: | 

Operator Firing Rule: An operator is 5 enabled to fire when all of its needed inputs are 

present and all of its output arcs are-empty: a ; 
This rule reflects the correspondence of. data flow:graph arcs to machine. registers, which requires that 
the occurrence of more than one token on any arc be prevented: Restricting data flow graph behavior 
in this manner is’ necessary to cnsurc determinate: and deadlack:.free execution for the architecture 
assumed. ‘Fhe analogy betwecr the data flow graph charactcristics.of detcrminacy and deadlock and: 
the Petri net theory properties of safety and liveness suggests the use of Petri net theorctical results ¢o' 
formulate and verify the d/a arc pair transformation. In fact, the suateey ake in MeveOnine the safety 
transformation is to extract mievent Petri.net: canecnis and: rodefing then: for data flow srigtie: 

This.chapter precceds with-a closer Jook at the data flow-graph:~Pctri act-analogy, particularly 
focusing on the possibility of modclling the former: with the later. ; Section 2.3 expands onthe safety - 
transformation and its effect in guarantceing dcterminate (safe) and deadlock free (live) operation. *: 
While showing the cxistence of the former is straightforward, asignificant:question concerns ‘whether 


or not the restrictions imposed to-ensure safety affect liveness © 9. 
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2.2 The Petri Net - Data Flow Graph Analogy” 
2.2.1 History and Analogy 


‘The major contribution of Petri nets is to aid in understanding systems. A closer fouk at the 
components of Petri nets scems an essential first step. -As shown in the Figure 2.1 cxample, a Petri net. 
isa graph composed of transitions ane Places with an aa Manis ee the number of tokens 

(pieces of data) readin on neach place. The transitions. vaiauid laces ocleassi jase to data flow 
graph opcratorsiand arcs.:A token must reside on cach énput place to a transition for # tobe enabled for 
firing, where firing the transition causes a token-on cach: input place to be: removed, and.one to appear 
on-each output place. Figures:2.1(a) and (b) respectively. show the Petri-net token:con figuration before 
and aficr firing transition 1. ‘Phe operation of a Petri net is safeaf it behaves according to the following 
definition: 

: Definition, For a niaiiiae M, a fc hes is ae it for ew, carting M* that Ga be | 
rcached by a sequence of firings from: M; thervis:atmest onc token on-any place. 
This is preciscly the bchavior that we. would like data flow. graphs to satisfy.~ Note that the Figure 2.1 
graph is, in fact, not safe since the sequence of transition firings: th: 44;th will place two tokens on place — 
F. 

We bricfly survey the cvolution of Petri nets:to: introduce th¢ thcorctical results that could. 
prove applicable to data flow. Petri ncts were initially presented by Retri.in 1962 (26) and modified by 
Holt in 1968 [15]. Extensive study of safety and liveness for Petri nets of the marked graph and state 
machine varicties has been done by Holt and Commoner [16]. Each of these classes form a particular 
subset of free choice Petri nets. This work has been extended by Michel Hack [14] to include free 


choice Petri nets. Hack introduces production schemas, similar to data flow graphs, and asserts that 
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Figure 2.1. Petri net token configuration before and after transition t! firing 


— transition 
C) place 


@ token 


(b) 


i 


see production schema can be represented by a free choice Petri net. A major result known as the 
livenieee-andisaneiegs theorem states ieaitatiices under which a free choice net displays these 
propertics. We explore the possibility of using such a result in producing determinate and deadlock 
freuidats flow graphs Guarantecing safety for free choice Petri nets involves ensuring that every place 
is part of some dirceted cycle containing one token. This fact sean orive useful in determining ifa_ 
data flow graph is safe, or in modifying it to be safe: We seck a modelling of data flow graphs by free 


choice Petri nets which allows us to conclude that a data flow graph is safe and live if its corresponding 
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Petri net is safe. 
2.2.2. Modelling Data Flow Graphs with Petri Nets. 


The data flow graph firing behavior requirement that no are ever hold more than one token, 
forces us to focus on the correspondence < Sk flow graph arcs ; Petri net places. Were the 
correspondence of places to arcs 1-1, showing the Petri net madel. places safe would prove the data flow 
graph arcs "safe". Unfortunately, this is not always the base as is seen in modelling data flow graph 
control structures. 

Consider the graph of the conditional construct in Figure 2.2. Evaluation of the predicate 
results in enabling either the T, re F gate which respectively dctermines-wheihee the input data value x 
will be processed by /7 or f2. A free choice Petri net model ve this data flow graph must enable a token 

te #4 

to.procede down one of two paths to reflect the two branches of ‘the conditional and must merge the 
paths. A possible model is shown in Figure 2.3. Places and transitions aren ns to Scnibalar arcs © 
and operators in the data flow graph are so designated. In comparing the decision structures of the 
Petri nct medel and data flow graph, note that place aa’ in Fiawe 2.3 represents two arcs in the data 
- flow graph. Although the mapping between places and arcs is clearly not 1-1, the Petri net decision 
structure presented is essential for allowing a token is take one of two paths. Unfortunately, this makes 
it more difficult to determine how properties of place aa’ correspond to thos of er and 2’ - 

A significant difference in the actual control’ structure is the absence of f specific pee and 
transitions in ‘the model to represent the data flow graph eee and its output coated a arcs. Whereas 
the decision concerning which branch of the conditional construct will be executed | is uniquely 


determined by the jahpiik of the predicate, the Petri net is siibelormibniitic. srovidiing a model for all 


possible decisions: Though each token arriving at place aa’ will cause only one path of the Petri net to 


Figure 2.2. Conditional constract data Now graph: 
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become active, both paths are potential candidates. ‘This situation omphasizes the use of Pctri nets as 
. gencral models for specific systems - in this case, data flow graphs [22}. To remedy the modelling 
problems of the Figure 2.3 Petri net, a more specific model shown inFigure 2.4 is built which attempts 
to localize the nondeterminism in an added portion of the Petri net meant to represent the predicate 
and control arcs of the data flow graph. The:behavior of the Figure 2.4 transitions modelling the data 
flow graph T and F gatcs is consequently deterministic, since firing is now dictated by the portion of the 


net labclicd “predicate evaluation”. A’ token on place aa’ will gnable cither the T or F transition, 
ony a 


Figure 2.4. Pctri net model of Figure 2.2 


thereby determining its path. 

Though this Petri net modelling of the conditional construct more accurately captures the data 
flew graph behavior, the portion of the net representing the ‘T and F gates violates the structure 
dcfining the free choice subsct of Petri nets: If a transition following a particular place is firable at.a 
marking M, then all transitions following that placc are firable.at M. Informally, the definition of a free 
choice Petri net states that every arc from a place; must.be either the unique output of the place or 
unique input to a transition. Thus, the configuration involving-place aa’ andthe Tf and. F transitions in 
Figure 2.4 violates. the free choice property. Since free choice nets form the Jargest subsct of Petri nets 
for which a developed theory of liveness and safety exists, there is.no advantage to pursuing. this 
modelling route. For this reason we change directions,. attempting. to- accomplish our goals more 


directly by extracting the relevant concepts of Pctri net theory and redefining them for data flow. 
2.3 The Data/Acknowledge Arc Pair Transformation 
2.3.1 Achieving Safe Data Flow Graph Operation 


Since the Petri net propertics of safety and liveness reflect the behavior we want data flow 
_ graphs to display, we attempt to redefine these terms for data flow via the correspondence of ares and 


operators to places and transitions. 


Definition... For an initial configuration of tokens, a data flow graph is safe if every 
configuration of tokens that can ‘be reached from. bcs initial configuration contains at 
most onc token on any individual arc. : 


Definition. An initialized data flow graph is live if a complete sct of inputs will 
eventually cause a complete set of values to appear on the output arcs of the graph. 


To ensure safe operation in Petri nets, every transition in the net must be part of a one-token directed 


cycle. Adapting this for data flow is accomplished by introducing initialized data/acknowledge arc pairs 
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(d/a arc pairs) and cnsuring that every arc in a data-flow graph is part of such: a:pair. 
‘The mechanics of the transformation iflustrated in Figure 2.5 involves replacing cach full data 
-are with an arc pair composcd of a full data arc and empty acknowledge arc; and-cach cmpty data atc 
owith-an arc pair composed of an empty data are and full acknowledge arc. Alternatively, Brock’s T 
algorithm can be modified to produce graphs with d/a arc ‘pairs, rather than infinite queue arcs. We 
distinguish the. two by terming such an algorithmFy,,, a8 oppuscd:to F,,. ‘The Figure 2.5 graph 
segment ‘labcHed, “pre-firing state” represents: the transformation of the graph scgment to ts left. 
‘Having defined this transformation we must Vcrify that; in. fact: it:accomplishes its intended function - 
to cnsure the safcty and liveness of data flow graphs. 
An initially transformed: graph is. potentially safe:since cach of its arc pairs holds. only one 


token. What-must be shewn is the-preservation of this property under firing. In the. pre-firing state of 


the Figure 2.5 graph segment, OPI is the only enabled operator since it is the only operator which has 
i eee SS pee ee ON Hee a 


teak. HET: ‘a 


4 ols 


Figure 2.5. D/A are pair transformation 
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tokens present on cach of its input ares. Firing OP1 produces the poust-firing state shown. The firing 
action results in the absorption of.a token. from each ofOP?'s input arcs and the production of a token 
on cach of its output arcs. Consequently, OP1 is disabled; and OP2. becomes the only enabled operator. 
More importantly, OP]:cannot be tecnabled until it receives ‘beth a data, and: an acknowledge input, 
where the appearance of the later is dependent on firing: OP2:: -Firing OP2 will absorb its input data 
token.and produce an acknowledge token, input to OP1.- Thus, OP 1's output data arc mrust be empty 
for it to fire a successive time, producing a new data output: .'This: reasoning, shows the firing behavior 


dictated by the data/acknowledge arc pair transformation is safe. : ~ 
2.3.2 Preservation of Liveness 


Verifying livencss of data flow graphs under the d/a atc pair transformation is more difficult. 
Duc to:its determinate nature, a result obtained from a Ty 7q Staph wilt match that-of its corresponding 
Too graph: Any T,,, graph firing sequence is a legat firing sequence in the T., graph. The question 
to address is therefore, whether the firing- rule constraint: causes: some Ty Za Staph to deadiock that 
would not have donc so in its T 44 version. 

The intuitive feeling that Ts gopms and their ities cua Tay: . Juda prodice the same 
results is established via the theorem stated below Is proof consists of a structural induction on the 
size of data flow graph expressions. By asserting an induction hypothesis for expression subgraphs, we 
show that the liveness property holds for Ty /a graphs — of acyclic interconnections of exp 
subgraphs, or graphs whose top level is a conditional or itcration eee 

In analyzing the Taya iteration expression, we have to make some assumption about the 
behavior of its iterbody operator which represents an itcration subgraph. Recall that ihe T, translation 


function produces iterative graphs which have one set of input ports and two scts of output ports 


through which valucs can be iterated or returned, as well-as a control output. port to signal which of the 

-two occurs, The behavior of the ports of an iterative subgraph within a woll-formed live TF graph can 
be characterized. as follows: . When: presented with: sctsiof inputs, the subgraph will produce. n iter? 
control valuies-- k true (0<Sk <n) and.n-k false: and correspondingly, & sets of I'data valucs and: n-k sets 
of R data values for a total of a data output-sets. To prove tiveness fora! Ty), graph containing an 
ilerbody operator, we must first show that the port bchavior of ‘Ty ,, iterative subgraphs is the same as 
that.displayed by To, iterative subgraphs. ‘his willvallow: us to assume the’ desired. iterbody port 
behavior, an cssential step in proving th expression live. 

Proving the correct port behavior for Ty s iterative subgraphs consists ofa riage courts 
within the larger inductive proof. Since the iteration rapt : Selvin instance of an 
itertedy operator, the subproof should naturally. appear: just-ptior.to :praving ‘the Ty, iterative 
expression live. , However, 4o.stem confusion only:a statement of the assumed iterbody operator port 
behavior will be.made: ‘An: outhine- ef the subproof follows: the inductive proof... Finally, inherent in 
this discussion ig the: assumption that tho-cquivalonec of T gg and corresponding’ Ty), graphs is being 
shown for graphs which are well-formed, where this term is defined as follows>.: 

Definition. A well- formed data flow une derived from a a sytatcaly correct ne 

progrant using the-T, translation.algorithm, = 2s 
We proceed with the liveness theorem. 


Theorem: A well-formed live data flow arah wil remain lve under the d/a arc ee 
transformation. Pe Uy gh ONG - 


Stated in operational terms: 
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Any Ty,q graph corresponding to a well-formed ‘live To, graph, when presented with n 
complcte input sets will either: 
(1) have produced n complete output sets and absorbed n acknowledge sets on its 
output d/a arc pairs, and emitted n acknowledge scts on #9 input d/a arc pairs, or | 
(2) contain some enabled operator. 


Proof: 


Basis: A data flow graph consisting of a single functional operator will remain live under the d/a arc 
pair transformation. - | peas ; a 

An initialized functional operator is shown in mipuE 2 2. ~ On ere ofa ceompicis input set, 
the operator will be enabled and when fired, will produce an output token ain ihe ace Qwietee 
token on its output arc pair, and emit acenoy cee mokens on its fs input ae arc E pale Since ne operator's 
output arc pair is the afaeh output are pair, within i nit tn time the output token owl be absorbed and a 
corresponding sno ee token supplied reiniiaizing the sap If an nth s Set of pnpurs hs been 
presented to the operator and an nth output nasn not appeared, then the acknowledge a arcs of the input 
arc ire must have secn rithile nth acknowledges n- 4 oF which were produced by fring aperalor sf Dhl 


DE speed ~ eS 


implics that the state of the output d/a arc pair is one aor the siomawlia? The data arc has its n-1st data . 


Figure 2.6. Initialized data flow graph of a functional operator 


f 


value and the acknowledge arc.is empty but has seen n-] acknowledge tokens; the data arc is empty and 
the acknowledge arc is holding its nth acknowledge token. In the first casewithin finite time the n-Ist 
data value will be absorbed and an nth acknowledge token produced peer the operator. In the 


second case the operator. is ccnaiaae 


Induction Hypothesis: In response to an nth complete input set, an exp operator (expression subgraph) 
will either: 
(1) have produced an nth complete output sct and absorbed an nth acknowledge set 
on its output d/a arc pairs, and emitted an nth acknowledge set on its input<d/a 
arc pairs, or 
(2) contain some enabled operator. 
Acyclic Interconnection of exp operators 
Assume that the Figure 2.7 erph has fick presented with an nth set of inputs a and that it has 
not produced an n nth outpiie set. We will show that the sraph must contain an enabled operator. 
- Suppose. the sath has produced j output sets whee ixn, ‘et the output arc pairs have had 
their jth data values atisarhod: and are holding their jest acknowledge ken This implies that exp 


must have scen at least j caput sets. Three poss arise. | 


Figure 2.7. Acyclic interconnection of expression subgraphs 
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Suppose expy has not yet seen its j+ Ist input set. Then by the induction’ hypothesis, since 
exp, has-scen its nth input sct and only. cmitted j output sets where j<n, exp, contains an enabled 
operator. 

Suppose exp, has seen part of its j+1st input set. ‘Then by the induction hee ee since expy 
has secn its nth input set and not yet emitted a complcte j4+ Ist output set eho i+ <n, exp, contains 
an enabled operator. | _ et 

Suppose exp has seen its i+ Ist input set. ‘Then singe expy has its j+ Ist set of input 
acknowledges available, it has stance a j+ ist output see ni. by the induction hypothesis 


contains some cnabled operator. 


Conditional Expression 
The conditional expression is shown in Figure 2.8. In its Tg, form, when presented with n 
inputs, exp) will produce.n boolean outputs; k (rue where 0<k <n and:n-k falsc. In response to this, 
-the M: gates will sce a total of:n data input sets -- kon their truc data input arcs and n-k on their false 
_arcs. -' These are merged.to preduce the graph outputs. according to the.n-M gate control inputs ¢k trge; 
n-k false} which correspond to the M:gate data inputs. 

-- An-important. consequence of the d/a firing restriction is that once a control input value is 
presented to the M gatc, a successive control input cannot appear.on that control.arc {octween a and 
the M gatc)- until the M gate fires to absorb the previous value and emit an acknowicdge token. The 
implication of this is that a is.prevented from firing a successive'time to reenable any gates in the graph 
before the output sct corresponding to the previous control: valuc has been produced. This in turn 


implies that only onc input set will bc within the branches of the conditional expression at any time. 


Figure 28. Conditional construct: data flow graph 
jal in2 . or ins 


Assume the graph has: rcecived an nth set:of inputs. . Assame further, that no ‘operator is 
 crabled within exp). By the-induction hypothesis exp, must have produccd an nth output set. ‘The d/a 
_ are pair between a. and the M. gate can be in one of two:states. Either the arc pair is holding its n-ist 
control value, or it is holding an nth acknowledge token. -Asgume. the: arc pair is holding its n-ist 
control value. Ry the functioning of the graph described above, this: implies that the n-Ist:input set is 
-being processed... Since the graph has received its nth input se this implics that the:T and F gates must 
have cmiteed:an n-Ist sct. of acknowledges by firing in respense to.théir:n-1st‘sct of inputs. We can 
assume as a result, that either exp, or exp; becomes enadled: By the induetion hypothesis, within finite 
time. we will sec the n-lst output sct on the appropriate exp output data arcs. and an nth -set_of 
acknowledges.on the exp input. arc pairs. This action ‘enables the M: gates -which when. fired -will 
produce an n-\st set of graph outputs and emit acknowledge tokens along its data and control input 


arcs. At this point, the arc pair between a and the M gate is in its second possible state-- holding its nth 


acknowledge. Note that if a is fired, which is now possible, the graph will-be in: the state it was in when 
_ the arc pair between @ and the M gate held its n-Ist control value. Since within finite time the n-Ist set 


the above reasoning to show that an nth sct of a outputs isproduced 


Iterative Expression 


We assert the following concerning the port behavior of the ifterbody operator: When 
presented with an nth complete set of. inputs, the subgraph represented by iterbody will cither produce 
n iter? control values -- k true and n-k false? ‘ahd correspondingly. | k sets of I data values and n-k sets of 


R data valucs or; will contain some enabled operator. 


' The iterative data flow graph is shown in Figure 2.9. We can make the following observations 
concerning the functioning of the graph in. its Tava form.-Nete that firing copy operator 1 causes each 
of the M gates to be presented with. the next control input. The anplication of this is twofold: Operator 
Lcannot fire until every M gate has fired; absorbing its- previous control. input apd emitting 

acknowledge tokens; the number of input sets processed by each M gate is:cither equal-to, or one less 
‘than. the number of control inputs that have been’ presented to cach, M:gate. The operation of an 
iterative graph is such that a set of input valucs.will be itceated ia response to true wer? outputs until 
iterbody produces a false iter? output which signals return of the values. We consider these two stages 
of Twa graph behavior -- NETH values and returning valucs, Separates Since the aynehroMen 
affect of copy operator L prevents; any interesting overlapping of graph anh sets, it suffices to show 
that when arcana with one scape iigue’ set the graph will ataduce an Gurput set without 


deadlocking. We begin with the return case. 
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Figure 2.9. Iterative data flow graph 


Assume: iter? produces:a false valic. « By’ the first implication above; L-vannot-present the M 
_gates with this value until-cach has fired to acknowledge L and produce a data input to iterbody. Thus 
-iterbody must see a complete set of inputs for the M gates tobe reinitialized. The stated: behavior of 
iterbody dictates that within finite time ‘a complete set of return values. will be produced in 
correspondence with the false iter?. Thus if the M gates are reinitialized: a set-of outputs is guaranteed 
without the possibility of deadlocking.- The possible-ways of aideadlock occurring are considered in the 


iterative pathy argument which follows. 


We proceed to show that a deadlock does. not occur within the iterative path of the graph by 
aeumn’ the opposite and Teaching a contradiction, aba te conclusion that an enabled 5 aaa 
exists within the graph. Assume that there’ exists some well- formed ive itcrative data 1 flow v ap which 


deadlocks under the d/a arc pair transformation. To see how the deadlock occurs we ails the same 


sequence of cpmiputiian steps to. a Ty, graph and its corresponding T 47, graph, until we reach a state 
where there cxists some operator which is-enabled:in the T,, graph and ‘not enabled in the Taya 
graph. The causc of deadlock must ‘be that an operator ‘in the Ty Za Staph has its inputs available, but 
cannot fire duc to the presence of a token on its output arc. “We attémpt tu locate this'‘opcrator, which 


must be an M gate-or a gate within iterbody. We proceed to- consider cach Case. 


Assume merge opetatay Mo is in such a state, cone se it has its jth set of iteration inputs 
i a ah pets 228 
available. The token on its output arc, rapelled q, must: be used in producing. iM Vi iterative input value 
of some Our M gate, say Mi. Since the ely Ve graph is ssesatsbn one . two situations $ must exist: 
_(1) The path taken by token .q through: iterbody to the Pinput of gate Mi is blocked 


(every arc is full). 


Q) Token q is input to some Operator which lacks some mpye and therefore is not 
enabled. 


Assume (1). Recall from our preliminary discussion of itetative graph operation, that if token q 
was produced as a result of the j-1st input-set, it will be ‘used to produce the jth f input of some M gate 
which, according to the assumption, is blocked. ‘Thus, the-tokeri currently residing on ec f input to 
that M gate must be part of the j-Ist input set or some set previous to the j-Ist set. ‘This implies that the” 
M gate has not yet fired j-1 times. But from our knowledge of iterative gtaph operation, this is not 
possible since firing copy operator IL to present cach M gate with 5 jth contro! input required the prior 
firing of cach M gate aj-Ist time sending i achnuwledes to - -- acontradiction. 

Aesiiie (2). pine firing Ms a sith time is oy possible i : cae M hagas has ree yl times, it must . 
be et acomplete sct of i inputs to ierboy is available contracting the assumption that some input is 


not present. 


Assume the disabled operator occurs. as a result of  iterbudy and that its output arc is an I output 
arc. If the disabled operator has a jth sct of inputs available, then they will be uscd:to produce the 
j+ Ist L input of some. M gate. The token on its output arc, must therefore be a:jth. } input of that M. 
gatc. By the twofold sipaicgeion sencd above, the. fact that the disabled-opcrator: has. its jth mputs 
available implics that every M gate was prescated with a jth control iapyt and has fired cither j or j-1 
times, Thus the M gate which has its jth I input a must have fired i times. If we can show © 

. that this M gate is enabled, then within finite time it il fire, sending: an n acknowledge to >the blocked 
operator. Consequently, i in + fin nite time there will be an n enabled operator within eibody 

We know. that the M gate has its jnpats available, so it can n only be disabled if its output arc is - 
full. Assuming this situation; the 4oken on its output arc. myst be.from the aie input sct and: will be 
used to. producc the jth input of some other M aoa But then we know ‘that within finite time the 
operator to which. this token is input will fire since by the twofold epcainn. every M ue has fired 
j-] Gmes: ‘This simultancously. cnsures. that the operator has .its inputs available and has an empty 
ssc are The acknowledge: necessary to enable the M_ gate will be seat.as:a result of firing the 
operator. ‘Thus, within finite time, the M gate and subsequently the blocked operator in iterbody will-be 

It follows that ifthe Tg, graph is well-formed and five, the corresponding Ty,, graph is 


well-formed and live. Q.E.D. 


The subproof: panccinlng port behavior for iterative subgraphs is also mauaives in n that it must 
assume a behavior for iterative operators within subgraphs ‘i then prove > the behavior for the top 
level structures defining iterative subgraphs. The behavior to > be dota has been stated above at the 


start of the section of the proof dealing with the iterative expression. 


The simplest itcrative structures, exp and iter exp, are shown in Figure 2.10. Since the iterative 
subgraph proof is within. the inductive proof above, the induction hypothesis concerning exp subgraphs 
is valid. As a consequence, proving that the Figure 2.10 graphs satisfy. the stated behavior is trivial. 
Establishing this fact for the conditional itcration body, if exp then iteration, else iteration, is tedious 
and will not be presented. 

Having developed the data/acknowledge are pair transformation and shown To, and Ty, 
graphs cquivalent, the task of determining the quality of this solution remains. Major concerns to 
investigate focus on cost and efficiency. Chapters 3 and 4 address these issucs and present 
optimizations of the solution subsequently developed. Example graphs in the remainder of this thesis 
are assumed to have been produced by algorithm Ty Ja Therefore, though not explicitly shown, all 


arcs represent d/a arc pairs unless otherwise stated. 


Figure 2.10. 


iter? li iter? Ri 
(a) exp (b) iter exp 
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CHAPTER THREE 
- 3.1 Balancing Token Flow 


The optimization to balance token flow discussed in this chapter. addresses certain 
inefficiencies introduced by the acknowledging scheme presented in chapter 2, Though the d/a arc 
pair transformation prevents the occurrence of mire than one token tian aie ak any ‘inne: the firing 
restrictions it imposes are severe, and may significantly curtail concurrency. Specifically, the 
requirement that an operator reccive aeknowledae signals on caeh of its aiput ee beers rafiriig: 
unnecessarily delays computation of successive input sets. While ensuring the ifeopctation of the 
graph is essential, it is possible to identify which output arcs are potential bottlenecks, and modify each 
so that it can be safely implemented as a fixed size buffer. ‘The purpose of this change is to effectively 
enable arcs to hold more than onc token, thereby climinating bottlenecks by allowing computation of 
successive scts of inputs to "pipeline" through the graph. Safe implementation of these buffers involves 
the use of identity operators which, when inserted Sone anare set a place holders ‘Identifying arcs 
within a graph that may cause bottlenecks, and determining the extent to which they should be 
buffered are prerequisites to Siete modification. While the former of these tasks is straightforward, 
deciding on a buffering strategy is subject to a number of considerations including graph configuration. 
~ and cost of buffering. | | 

| A simple cxample is seen in section 3.2 which clearly illustrates the problem addressed in 
this chapter, and serves to motivate the subsequent optimization. This, discussion is formalized in an 
algorithm which produces optimized graphs. The section concludes by pointing out certain subtleties 
of graph operation and factors not accounted for in formulating the praposed solution. In response to 


this, section 3.3 introduces a modified version of the section 3.2 algofithm, along with several 


comparative Studics of graphs in their limited and fully buffered configurations. 
3.2 Formulating the Optimization 
3.2.1 Identifying the Source of Bottleneck © 


| The 0a of the optimization to balance token flow through a 1 araph i is to increase throughput 
by modifying a graph to allow for maximum Pipelining an bottleneck problem, and therefor 
application of ane opamization: arises in =e amen of a data flow graph. A clear Mlustfation of 
the problem is shown in meRieure 3.1, the graph translation of the VAI. ra a ats 


if f=1 then fl else 2 


Figure 3.1. Buffering for a conditional expression 


xy s 


The interesting and. problematic issues arise when considering the consequence of presenting 
_the graph with multipic input sets. Hopefully, precessing of a.second.sct of inputs can begin before 
. outputs of the previous set. appear, with the. optimum situation being one in which sets of inputs 
pipeline through the graph. Unfortunately, the control structure of:the graph dictates that the overlap 
in processing of successive scts of inputs be minimal: Only.one set.of values may be within the — 
branches of the outer conditional at any time. aoe to Figuy - 1, we sce that in order for a second 
set of values to enter the branches of the cjuditional both a ‘and B rane a ond time presenting 
the sets of T and F gates with new control inputs. However, @ cannet fire.a sccond time until the M 
‘gate to which it also sends-a control. input has fired to emit an ackpowledge.. Thus, the d/a arc 
connecting a and the M gate:(marked in Figure 3,1 by. slashes), prevents scts of valucs from pipclining 
through the graph, creating a bottlencck whase severity depends onthe depth: of the:computation 
performed within the branches of the conditional. - 

Eliminating this undesirable behavior so that successive sets of valucs may pipeline through the 
graph involves finding a method of enabling node a sooner, conoabeally allowing the aiened arc to 
hold more than one token. The ideal situation would be one in which the arc could hold as many 


tokens as the number of sets of values that could be pipelined carci the graph. 
3.2.2 Preview of a Solution 


Introducing identity operators into the graph: provides means of realizing the desired 
behavior. Specifically, inserting identity operators along the slashed arc (Figure 3:1) would break it into 
d/a arc pair segments, allowing node a to’fire several times before forcing the M gate to fire. Using this 
technique on Figure 3.1 to attain maximum pipelining | is ee by replacing the slashed arc 


with the arc segment shown to its immediate left. ‘AS a consequence of this change, the state shown in 


Figure 3.2 in which three sets of tokens are pipclining through the graph, can be reached. (The token 
sets have been numbered: accordingly’ for clarity.) “Thus the introduttion of identity nodés has 
climinated the: bottleneck: Generatizing this’ optimization ‘technique tequires a determination ‘of the 
idcal number and tocation of buffers to be inserted. ‘To responif to such considerations, we attempt to 


analyze how tokens flow through the graph. 
3.2.3 Analyzing Token Flow to Characterize the Solution 


_ Though . the: data: flow’ computer operates: ‘asynchronously’ arid ‘data flow programs 
nonsequentially; ‘we can model optimum token: flow through the ‘graph’ by assuming a somewhat 
synchronous behavior. ‘To do this, we analyze the firings ‘within the graph in-terms of time units where 
during any-given unit of time all enabled actors must fire and produce a result ‘This assumption 


attempts to approximate optimum behavior by preventirig ail enabled ‘actor’ from rémaifing enabled 


Figure 3.2. Token configuration alowed by buffcring scheme 


ee 
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and thereby | slowing up processing for any length of time: Recalling that our: aim is-to pipeline 
computation ihroughane graph, we wish to pasha amethod at ene me graph so that under this 
“synchronous behavior” saiimpiion it displays maximum pipeliriing: aiid: Sanscenontly best 
throughput. Ope 
Referring back to pau 3.1, we note that every saat sct to the suph fesults | in the production 
of a token on the control (stashed) arc, and tokens that will either be processet! by./7 or f2. While under 
the synchronous behavior assumption the tokens being ra by these functional ae can 
move one stcp through the graph during every time unit, the contol ike on the slashed arc cannot, 
and must: remain stationary unt its corresponding pach pope ‘tarot h te graph to Sak the M 
gate. As saison seen, the inability of the control arc to accept a second token prevents any tokens i in 
a successive input set from being mpeles ane eepeneene): between sie control arc and the Branches 
of the conditional, a the consequent ied to 0 equal their butering capacities to attain maximum 
pipetiing has been revealed by rite sion oF dontiy nodes shown in Figure 3. 2. An algorithm to 
Saualie buffering along eraph pats must be able to identify dependencies within a raph and ppeine 
heir paths. This can Oe geanaianed by an arc ie siherne whic compares 3 and sgualive 
buffering capacities of cepenzent paths, hecegniced by identifying none anlpala or gates which 


join two or more Paths. An Mutation of the algorithm which performs this optimization follows its 


srcsentation: 


Algorithm to Maximize Pipelining -- I 
Starting from cach graph input, descend through. the sitet assigning consccutive 
numbers to arcs joining successive sets of operators until a multi-input operator is 
s-encountered.- Compare the arc numbers on the input ares of the aperator and: 
(a) if equal, continuc the arc. numbering process 
(b) if not equal, balance the anes. by inserting idchtity operators into 
the lower numbered arcs. Renumber the biel arcs and 
continue the arc numbcring process. i 
_ Note that if theo operator is an M gate, the Sep aTEOn and balancing described above must involve all 
three apie arcs, using the highest numbered arc as the goal | | 
The result of apoljiag this ideas to the er transaton of the following program scones 
shown in Figure 33: - SO 
) iff=1 then if s=1 then xy +1) alex onde x end 
For reference Purposes, the added identity cle have ect ‘numbered. : The seven numbers shown at 
the extreme ict of the raph result from the arc = aiambeings process “id apply respectively to 
appropriate arcs moving horizon across the carb Nodes u and R aie been added in response to 
the imbalances which occur hee comparing arc = Gebee on ‘jhe! input arcs to the mulipicaton 
operators. 13 through 15 are sided in response to the comparison of the input arcs to the i inner M gate. 
Note that, as 5 specified i in the alporithtn: arc auinbe: coenpariaons ane all three M ie npat arcs. 
Finally, operators 16 through 115 are introduced as a result of comparing input arcs to the outer M 
gate. 
One essential question to ask is whether or not the addition of identity operators changes the 
functionality of a data flow graph. This can be answered by recognizing that the essence of the change 
resulting from the application of Algorithm | is to replace some of the one-token arcs of a graph with 


- queues of a given finite length. Since successive identity operators along the arc are separated by d/a - 
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Figure 3.3. Example of maximal pipelining 


s x y 
L, 
XE} F 
* 
Rt 
BCI 
“yaCr) 
6 -—— 
Le Xm) “1Ce 
oS 


arc pairs, the graph remains deterministic; and since an identity actor merely passcs its input to its 
output arc, the functionality of the graph is unaffected. These observations ensure the functional 


equivalence of an optimized graph. 
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3.2.4 Observations 


In developing this example, there are several interesting observations to: make concerning the 
optimization and the specified algorithm. As stated above, the optimiration is : oomphiniel by first 
identifying and then pipelining dependent paths in the graph. While dependencies d detected at 
functional pperalons and Tr and F gates. can be handied as 5 nas une resulting from M gates hold 
some hidden considerations. Recall from: the algorithm that M gate comparisons ‘must involve the two 
data arcs and the control arc. The algorithm modifies ‘the ea to achieve maximum pipelining by 
equalizing buffering capacities ofthe paths through the graph to the control afc and two data arcs. 
However, while the M gate signals the dependency of each branch ‘of the conilitional operating in 
conjunction with the control are, the branches themselves are independent, Thus, while each branch 
must pipeline with the control path, they need not neotssarily pipeline with each other. If the two 
conditional paths are of different lengths, the buffering choices available are tw :equatize the control 
path with cither the shorter or the longer conditional branch, or to equalize all three. The latter of 
these, implemented by the algorithm above, achieves best throughput but has ithe disadvantage of 
causing the insertion of additionat identity operators in the shorter conditional branch. Thus, 
maximum pipelining may be aaiileven at the expense of including a number of unnecessary identity 
one The other two chores ieeuente the independence of the two conditional paths and avoid 
€XxCess buffering, but asd at the cost of reduced throughput. | | | 

A factor not evel éouskiercd which interacts with this pipelining choice is me pteken distribution 
effect on the graph of a particular succession of input sets. In Figure 3.3 cach ‘pit set can take any of 
three paths corresponding to the three possible states of fand s. This makcs it unlikely that any one of 


the three paths will be filled with tokens, more likely that the control arc to the inner M gate will be 


‘filled and certain that a continuing succession of input sets will fill the control arc to the outer M gate. 


- 43- 


If we consider a pattern of input sets such that no one of the three paths is taken twice in a rew, identity 
nodes I] and 12 would be unnecessary and could.be removed without decreasing the throughput. In 
fact, many of the identity nodes could be removed with no effect. Certainly, the frequency with which 
graph paths are taken is an.important factor in choosing a buffering strategy. An illustration of this 
point will be sccn in the examples in section 3.3.2. 

In identifying some tradeoffs and options to consider in maximally pipelining data flow graphs, 
it has become unclear whether or not this approach. is always optimal. Perhaps the advantages:of a less 
pipelined graph are.worth a decrease in throughput. Some key issucs influencing such a decision might 
include cost of identity operations, processor utilization, token flow patterns and. width and depth of 
program. ‘Though complete consideration of these would .require. kagwledge. of the machine and 
particular application, we attempt to illustrate the type of analysis that might be useful and necessary in 


making the choice. 
3.3 Full vs. Limited Buffering 
33.1 Achieving Limited Buffering 


Having questioned whether fully balancing a graph i is always necro or optimal, we speed 
by comparing several erapn. in both their limited and fully buffered versions tou uncover ihe tradcoff 
issues. A discussion of limited ! buffering including how it can a be achieved d and to to ‘hak extent nt Ty 
graphs display it is a necessary preliminary. | | 

The difference between full and limited buffering in a data flow graph is sen in the time delay 
between successive firings of its operators. In a fully buffered graph, assuming synchronous behavior, 
the time delay between repeated firings of any particular operator should be one unit: An operator 


which fires at time one should receive acknowledges from its successive operators during time unit two, 


| reenabling it to fire during time unit three. In a graph displaying limited buffering, the delay between 
an operator's firing. and receiving appropriate acknowledge Signals ‘may ‘be scvcral time units, thereby 
slowing repeated firings of the particular operator as well as‘all successive operators. 

Prescatly, the T,,,translation algorithm produccs data flow graphs in which every data arc is 
paired with an acknowledge arc. We could however, ‘have considered an’ algorithrn which’ caused 
acknowledge ares to span two data ‘arcs'by having cach acknowledge arc link altcrnate rather than 
successive operators. ‘The consequence of such a scheme would be a delay in the sending of 
acknowledge signals and hence, a-graph displaying limited buffering: While scction 3.3.2 discusses an 
example data flow graph so configured, this approach is‘ undesirable since it requires a‘ significant 
modification to the present ‘translation: algorithm. The necessity for sich an action is also unjustified: 
sce lines Cases, Twa graphs already ‘display Himited buffering, ‘as‘did the Figure 3.3 graph which 
was modificd to achieve full pipelining via Algorithm I. A slight revision of this algorithin will alfow us 
to produce data flow graphs which display limited buffering to some predefined degree. For example, 
it is possible to specify that the delay in sending acknowledge signals io i greater than two time units. 
The algorithm shown below produces graphs meeting this scquitenient “While: the ‘parpose of 
Algorithm I was to cqualize buffcring of dependent paths within a graph, the modification to the 
algorithm ecauies that dependent ‘ah _ ce seahie a specified bound. By allowing a graph to be 
easily reconfigured to display different degrecs of pipelining, the algorithm provides a feasible and 
practical contrat method of studying varying levels of buffering ina graph, The modificd algorithm is 


presented below as Algorithm II: 
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Algorithm (o Limit Pipelining -- 1 

Starting from cach graph input, descend: through the graph assigning ‘consecutive 
numbers to arcs joining successive scts of operators until a multi-input operator is 
encountered. Compare the arc numbers on the input arcs uf the operator and: 


(a) if the difference is less than or equal to 2, continue the arc 
numbering process 


(b) if the difference is greater than 2, insert identity opcrators into 
the lower numbered arcs to reduce the difference to 2. 
Renumber the modified arcs and continue the arc E-mu erine 
process, 


An application of Algorithm He a eel in section = 3 2 ales it is re applied to.the Figure 3.3 


Sraph We are now prepared to iat with sisal Sie comparrstns of full and limited buffering. 
3.3.2 Examples of Full vs. Limited Buffering 


This section pei two data flow graphs, in fon their fully and otha, buffered versions. 
The first cake achieves ented pipelining by relinking acknowledge arcs werner alternate actors as 
described in section 3.3.1 ae while the second exopls is modified for limited pipelining via 
Algorithm I. Our aim in each case is to compare the finetioning of each cxample’s graph 
confi Euan with respect to iin ano iececrent uct: _ ovesal concurrency. The 
following assumptions are made concerning the deaphs? éiidiation: — 

(1) Graph firings occur according to the "synchronous behavior" pattern described in 

section 3.2.3 


0) All graphs are produced by Ty, 7a With data/acknowledge arc pairs used 
throughout. 


We begin with a simple example in an effort to establish ‘some analysis guidclincs. The 
program sence cine in. Figure 34 is.a pate of binary epetajos which, if producedby Ty,,, 
should display full iooliniee: Thus, dete: is no need ‘to. apply citer algorithm to this program 
segment. Rather, studying this. graph ‘in limited pipelined: form: will acaee its restructuring so that 
acknowledge arcs link alternate aici The flow a tokens through the rah for our input sets 
can be followed using Table ab (For. convenience, the opeaion in the th sip have been numbcred.) 
The initial state of the ay given in T. able 3 1 at time 20, iow inate (IN) avaitable to OP! and OP2, 
and shila (A) present on all other arc pen itll pitas the table pane eid time axis, 
we sce that at time - oP! and op2 fire and seknowede FA) making inputs availabe to 0 OP3, and 
sie Saariseas on their spat arc pairs. During time unit 2, OP3 ies ndia a result token 
to OP4, which consequently becomes enabled, and.adkadivlerige tokens to-OP1 aad OP2. At the same 
time, a new set toFi inputs can appear on the input arcs to OPI and vs so that ey become recnabled. 
In time unit 3, OP1, OP2 and OP4 fire, sending appropriate data anid acknowledge tokens which enatle 
oP3 and OPS. These then fire in n time unit 4, enabling ops; as wel as oP! iil op? which, as in time 
unit 2, Seta eas receive a new sct of i inpus. This time unit 4s seit since during it, the output 
resulting from the first input set is protiiced! Following through the next few time units dima thak due 
to the aimawicdne hetie the best ‘hiouehoat posible bea fully Piping graph is an output 
every second time unit: Outputs resulting from the sccoad ‘ied third inpot sets appear in time units 6 
and 8 respectively. 

An examination of the table shows that once the ee is fl; (time unit 3), the operator 
firings of the graph can be sei into two alternating sets, ‘aa Sesealy. the. ‘gaol $s operation is 


characterized by two alternating states. SET1 consists of OP1, OP2 and OP4 firings, or those of the first 


and third levels of the graph shown in Figure 3.4. SET2 consists of OP3 and OPS firings which 


SATs 


Figure 3.4. Maximum pipelining in a simple data flow graph. - 
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Table 3.1. Flow of tokens for Figure 3.4 


ee ie out ut 2 Es 


operators a a 
OPS} A A A _ IN EAA IN Ea) IN FA 
-OP4| A A IN. F/A iad IN LR/AS A. 
OP3| A IN F/A_IN A IN'F/Al A OA set 2 
-OP2| IN F/A_ IN F/A IN! F/Ab A! AOA. ry 
OP1| IN F/VA IN F/A IN'F/Al A! A OA set 1 


time 


IN _ inputs present 
F/A fire and acknowledge 
A acknowledges present on input and output arc pairs _ 


compose the second and fourth levels of the graph. iced the fact at eae levels of the graph 


fire eaicnreney: we see that the minimum aie of concurrent Gpeanons eeanits a full pipe) is 


the lumber of levels divided by 2. ‘The maximum number is found by coriputing the sum of the width 
of each firable level for cach of the two sets to determinethe larger. ‘For the Figure 3.4 graph, SET] 
and SET2 consist of three and two concurrent operations respectively. ‘This information should prove 
useful in analyzing processor utilization. | : 

Having gathered these statistics, we proceed by considering Figure 3.5 which shows the same 
graph, but in its limited pipclined configuration. Specifically, acknowledge arcs link alternate rather 
than successive actors. Comparisons to the Figure 3.4 graph can be made by analyzing the information 
contained in Table 3.2, which follows the flow of iia iiieh this graph. The initial configuration 
of the graph, specified in Table 3.2 at time 0, shows inputs present on OP! and OP2 input arcs, and 
acknowledges available to OP3 and OPS. During time unit one, OP! and OP? fire to enable OP3. 
Note however, that the OPI and OP2 input arcs are net acknowledged at this time as they were in the 
Figure 3.4 configuration. Acknowledgement of OP! and OP2 is now dependent on OP3's firing which 
occurs during time unit 2, delaying the arrival ofa a new set of. inputs until time unit 3. Firing of OP4 
which also occurs Gans time 3 cnables OPS which can- fire to promace an output at time: 4... Again, 
reenabling of OP3 has been delaycd to this time unit, 4 when it receives sacknowiedge fron OPS and 
_. puts as a result of oP1 and OP? firing.. Time unit 4 is significant ia that. an: output is produced. 
However, following the opcratien of the graph for three ieput sets shows that the delay in. 
acknowlcdging operators has reduced the throughput to an drip every third time uni? The second 

and third input sets produce outputs in time units 7 and 16 respectively. 

Analyzing the operation of the graph using Table 3.2, we see that the acknowledging scheme 
allows every third level in the graph to fire concurrently, thereby partitioning the graph into three 
pntericaving sets of operators. Referring to Figure 3.5, levels | and 4 fire together, as would levels 2 and 


5, and levels 3 and 6, were the graph to be citoned: Corresponding respectively to these three groups 
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Figure 3.5. Limited pipelining in a simple data flow. graph . 


level 2 
level 3 


level 4 


Table 3.2. Flow of tokens for Figure 3.5 


output 1 | “output2  =——souttput’3 
operators Si Sisk : 
OPs| A A IN "FA! | oan "TF7A IN 
Opa] - IN Fi lawl pl Nor 
op3} A IN F/A — ! IN! Fva!  'IN FVA A 
-OP2| IN F IN! Bib Land RB. - eee 
OPi] IN. F IN' F! 'wile 


time 


Leta alee! 
state state state 
1 2 a) 


IN all inputs available 
F/A fife and acknowledge 
A acknowledges available 
F fire . 


are three states, shown in Table 3.2. Were the graph to be presented with continuous sets of inputs, its 


opcration would rotate among these three states. For this graph, the number of concurrent operations 
per state beginning with state 1 are: three, one, and one, (determined by compyting the sum of the 


width of each firable level for cach of the states.) Using the “concurrent operations per state" statistic 


shows that the Figure 3.4 graph alternates betwéen processing three and‘ two opcrations while the 
Figure 3.5 graph processes three operations every third time unit and only onc during cach of the 
intermediate two time units. The lower variance in the number of concurrent operations per state in 
the Figure 3.4 graph suggests that it will be more effi¢ient “with Aespect to processor utilization. 
Consequently, the only main advantage of the limited pipelined configuration is a reduction in the 
overhead associated with acknowledge signals. 

A second more involved sad ote complet example, applics this analysis, to the Figure 3.3 
graph, which appears in its fully pipelined éeiiguration. Note that unlike the previous example, which 


translates directly into its fully buffered state under Twa the production of the deca 3. 3 _Braph 


: feaator od 
t sragi i te ‘ 


required the application. of Algorithm. I. The most significant, point t to note is the eee to insert 15 


identity operators to attain full Pipelining. This TPES apbroximately a 50% i increase in ‘the fumber 


if 


of operators in the eraph, cake the cost of ide apenas vs. the bet of increased throughput | 
and concurrency an eriremely fia portant issue ito consider for: “an schiad data flow machine and 
application. a | . : 

Table 33 cents a summary of the token PER fully pipelined graph (Figure 3.3), 
assuming the control token produced by the predicate beak involving f is (ue. For cach time unit, the 
level of operators firing rather than the particular operators wif be spotificd, where the assignment of 


levels to operators is indicated in Figure 3.6. The total See ‘“ cach level as well as 


given. Thus, referring to Table 3.3, the second fine states that during ‘time unit J, the first level of 
operators fired, all four of which were graph operations. During time ‘unit 2, the sccond level of 
operators fired, one of which was an identity operator and five, graph operators. From the previous 


example, we know that successive sets of inputs will step through the graph with alternate levels firing 
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Figure-3.6. Fully pipelined data flow graph 


Table 3.3. ‘Token flow through Figure 3.6 


time |, firing level oe 4. identity/graph. 


inputs available _ 
. . odd levels 
even levels 


me NW RADA H & 


concurrently to produce an output every second time unit. In terms of ‘the table this behavior 
corresponds to the alternate firing of even and odd levels, where for cach of these firing states, the total 
number of operations and their makeup are: 
ODD 14 operations - S identity and 9 graph 
EVEN 16 operations -- 5 identity and 11 graph 

The Table 3.3 summary is only valid for two of the three possible ee states; true-truc and truc-false. 
A separate analysis is necessary for the case wher a is fe, | 

As in the previous ‘example, we “wish to. “compare these statistics with an amiss of the 
functioning of the graph in limited buffered form, ‘The soproprne ‘Braph shown in- Figure 3.7 is 
-obtained by applying Algorithm II rather thian Algorithm I to; (the Ta graph translation of the 
expression: 

if f=1 then if s=1 then 0+ eles -l}ead else x*y end. 

The most striking contrast between the fully buffered an (Figure 3.3) and this partially buffered 
version is the large reduction in inact SnkeGeun from 15 to 7: What remains.to be explored 
is whether the cost of this reduction is an accompanying decrease in performance (sec also (27). To 
determine this, we examine sevcral token flow analyses for the rigue 3. 7 Braph. ¢ derived by considering . 
different successions of input sets. The first example iti the nsies for four sets of i inputs which 
all follow the same computation path; true-true. The porgression of tokens through the graph can be 
followed via Table 3.4. The numbers in cach box in the table represent the spiccific operators which fire 
during that time unit (given by the horizontal axis), as a result of tokens from the appropriate input set 
(given by the vertical axis), where the operators have been numbered as shown in Figure 3.8. Referring 
to this graph, Table 3.4 shows that, (assuming input sct 1 is initially available), during the first time unit 


actors 1, 2, 3, and 4 will fire enabling actors 5 through 10 which will fire during the second time unit. 
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Figure 3.7. Example of limited pipelining , ea . : : 


The second input set becomes present (P) during the sccond: time unit.so that operators 1 through 4 
may fire in response to this second set during the third time unit along with opcrators 11 through 14. 
which fire-ia response to the first set. In this manner, the progress of the: four sets ef inputs through the 
graph can be followed. The time units during which the corresponding outputs appear have been 
noted in Table 3.4 along the top horizontal axis. This information reveals. the expected decrease in: 


throughput which may or may not be acceptable depending on the application... 
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Figure 3.8. Numbered Figure 3.7 graph to be uscd in conjunction with! Fables 3.4 and 3.5. 


As ‘mentioned cartier,.the probability of a succession of input sets taking the same computation 
path is smal. Therefore, a second analysis for. this partially: pipelined: graph appcars in Table 3.5 
assuming input sots 1 through-4 take the computation paths truc-true, truc-false, false and truc-true 
respectively. ‘The table.reveals that for this pattern of input sets the fimited: buffering scheme has no 
¢ffect on the throughput, which remains optimal at an output produced: cvery second time unit. This 


example confirms the point previously made concerning the significance of a sequence of input sets, A 
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tm 9 10 0 db 42 13 18 5 15 16 


Table 3.5. Token flow of four input sets through Figure 3.8 for computation paths true-truc, true-false, 
false, true-trite. 


—S SS 


further analysis of input sets for this data flow graph may reveal that, in fact, it is rarely necessary or 


best to transform the graph into fully buffered form. — 


3.3.3 Additional Considerations. | ee Rees 

Once an actual data flow machine is available, a study of the adcoft of throughput for 
number of inserted ‘identity operators should provide insight into the Girgetion to take’ ‘concerning 
optimization. Perhaps this information’ in combina witb panic application will indieate other 
optimization possibilities: “for instance: concentrating itor all “ony te mit somee of bottleneck 
within a graph. For the conditional construct ae point appears to be the contin! a arc to the M gate. - 


Modifications-of Algorithm ‘1 similar to the one ‘which produced Htgorithnl 11 could ‘also be weighed 


Titise Se 2S Padpeas ou: EY aah Ltn, aig 3 


more realistically as aliernative approaches. SE 

A final pol note in the consideration of this buffering optimization srategy is: ‘the aig of 
_. construct for which itis appropriate ‘The examples above: which involve conditional constructs and 
general compositions of operators, turn out to be ‘ait representative of the 1ypq of graphs. el which 
.this optimization is applicable. In fact, this optimization. poprosch is bisically inappropdate for an 
iterative process whose function is to modify and peace a single ‘sct of i inputs at-a time a process 
~ which docs not involve pipclining thowever, subgraphs withing tration may bepipelined), For such. 
constructs, a different optimization technique must be developed. This aematve strategy, ‘which aims 


errr 


_ to minimize the number of acknowledges in ina graph by ctiminaing those which are vances, is the 


topic of the next chapter. 
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CHAPTER FOUR | 
4.1. Eliminating Usneeded Acknowledge Arcs ~ 


This chapter aig an Suninaion cennue for removing mice hae arcs 
in a data flow graph. Though re uniform s substitution of data/acknowed arc pals for data arcs 
yields a correct siplensntition of a data “a rap, the acknowledging scheme is costly. The 
overhead of processing acknowledge packets is felt in the routing networks and instruction cells of the 
| data flow cufputer which must reseevely handle ihe iemuliagsin increase in traffic and nd bookkeeping 
Thus, there is vate in auelonie whether or not a ehnewiiee arcs are nee’ While it is easy to 
find aeanok data flow erp containing ar arcs for which an acknowledee i is unnecessary, Smnethodical 
identification of such instances is extromely difficult due to an n often context. dein decision: The 

stank configuration a and aa alas construct under ¢ consideration are re Pacts in determining 
| acknowledge arc removal. In response to this fact, the satay to 9 timinat anesdel scknowldge arcs 
Fectises 0 on individual VAI. constructs, attempting to identify canilidate d/a arc pa ane provide a 
socieaoading set of rules specifying conditions. Recunave application of its resulting set of rules is a 
ait flow graph derived from a VAL program can then be ied to test each candidate arc pair for 
removal of its acknowledge aie | | | 

The following section considers the 36 possibiliy of ue Petri s net meOLy to > govern eee ae 
arc igual and subsequently discloses certain data flow graph operational enatacteristics spoitnnt to 
the optimization process. Sections 4.3 and 4.4 develop acknowledge arc rove rules for the VAL 


conditional and iteration constructs respectively. The later section includes several aeanils graphs 


illustrating applications of the rules formulated for the iteration construct. 


4.2 Considerations for Acknowledge Arc Removal - 


The concern in removing acknowledge -atcs: from. a: data flow graph is whether the ‘safe 

operabon which the arcs ensure is maintained. oe we attempt once again to use Petri net theory as 
a \ guide, this strategy is ‘isoiniriand not “aay asa  consequenc of th the chapter 2 aon but as a 
rout of cxamining T and F gat operators which display a fundamentally different behavior than that 
of transitions. A look at hie operation of these gates and their eect on token flow shows the difficulty 
in using Petri Net theory, snd: motivates oie formulation of new requirements for safe foanovvak of 
sinowdge arcs in data flow "phe / - - 
*; The sie of the transition in Petri net ther is etek to tat a the hua oe flow 
operator Fiing a transition moves Satan on input pes w 6 output peso of the transition. ‘The T 
and F gate en which allows a computation to proceed in in one pores two p ways, is accomplished by the 
Pati net «configuration shone in Figure 2 2.3 and repent below i in Fi ie 24. 1, The essen difference 
in the operation of this Petri Net is. that once one of its t, or F transitions fires to place the input token 
oe a saree path, the transition conirollans entrance t to the alternate path is no icaigcs enabled. in a 
conditional ren flow sight when the gatcs coeponding to » the contial sipsie fire, the opposite ees 
remain enabled and must fire to absorb their i inputs as is dicen’ in Figure 42. 

Here the assumption is that the control input to the Figure 4.2 gates was thus. aes a token 
to flow through the T. gate to ‘eftable operator ft The dais flow graph Denaviog wil allow an output to 
be proihiced at the M gatc independent of shcthen' or not the input presente to the F gate has been 
absorbed. This phenomenon docs not occur in the Figure 4. 1 Per net since an np token is switched 
down onc of the two paths pavind no extra tke behind. The siiteae of this difference neon 
clear when considering the possibility. of i iterative graph con figinatodas If we fociis on the input arcs to 


.the F gate, and view the Figure 4.2 graph as the body of an iteration construct which recycles its output 
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Figure 4.1. Petri net model of the conditional construct 


F, merge 


Figure 4.2. Conditional construct data flow graph 


token, ensuring conflict-free operation requires that the mputarcs te the F gate be d/a are pairs. 

Since the possibility of a similar conflict is absent from the Pctri net modelling of the data flow 
graph, the difference in operation of the two renders Petri nets insufficient as a guide for acknowledge 
arc removal in data flow graphs. As a result, the applicability of Petri net theory to the process of 
identifying candidate arc pairs is limited. Ipstcad, the strategy followed cxamines the various VAL 
constructs to develop rules specifying conditions for ackpowledge arc removal for nes candidate arc 
pair identified in a construct. 

An implication of this conditional construct behavior is that the acknowledge arcs of the input 
arc pairs to a'T or F gate cannot be removed since the Bites of a token on an acknowledge arc is the 
only way to guarantee the absence of a token ap a corresponding data arc: A T or F.gatc output arc 
gives no indication of the state of the gate’s input ies since firing may or may not produce an output 
token. An illustration of additional problems pemulting ! pon T and F gate t behavior i in combination with 


the possibility of nesting conditionals appears in the next ‘sctien 
43 Analysis of the Conditional Construct 


. To illustrate the analysis needed for finding removable menowietes arcs we consider the data 
flow graph translation of a gencral eencitonat construct, shown in Figure 4.3. We begin by focusing on 
the slashed arc pair connccting a and the M gate. Recall that the behavior of this arc pair is such that it 
cannot accept a second token until the M gate fires to process the previous control token, and send an 
acknowledge token to a. This guarantees that a second sct of tokens cannot be within the branches of | 
the conditional until processing of the preceding-act has completed. While semouaing the restricting 
behavior of this arc pair was the aim of the chapter 3 optimization designed to balance token flow in the 


graph, it is an advantage to the process of removing acknowledge arcs as is secn by following an input 
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Figure 4.3. Tif exp then 7 else /2] 


a Vt 


set through the graph. Each input’sct (processed by cither /7 of 2): places a token on the control input 


- a 


arc of the M gate and a dela token on cach of the arcs labeled either a and b, orc and d, depending on 
whether the control token is true or false. Assuming that f7 and f2 dre-well-formed, an output should 
appear on arc g (assuming the control token is tue) within finite thnjebith no possibility of a second 
token appearing on arc g, or of any token appearing on ‘arc. h until the M gate fires. - This event 
simultaneously processes the token on are g and Satie an acknowledge token . a, consequent to which 
a successive input set may enter a branch of the conditional. The wied flow behavior guarantees that 


the acknowledge arc of arc pair g can be safely removed, as can that. of are pair h (by an analogous 


argument). 
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~ One might be tempted to remove the acknowledge arcs from asc pairs.a, b,c, and d under the 
assumption that ease a sct of tokens has entered a branch of the conditional, the tokens must be used - 
by: the appropriate function to produce the corresponding output. However, a considcration of the 
Figure 4.4 data flow graph will show that coniwal of acknowledge arcs for ae arc pairs is dependent 


on the subgraphs represented by f? and /2. _ 


Figure 4.4. Unsafe token configuration resukting from removal of c's acknowledge arc 
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The Figure 4.4 graph is a translation of the following VAL program segment: 
if f=1 then if s=1 then x*(y +1) else x end else x*y end 

Consider a sct of tokens ae through the graph which causes the outer ee f=1, to evaluate 
to truc and that of the inner conditional construct, s= 1, to evaluaté to false. The tokens on inputs s, x, 
and y should appcar on arcs a, b, and c, and evans become the data and control input tokens to the 
inner conditional construct’s ‘T and F gates. Since the inner conditional’s control token is false, the 
computation proceeds through its false branch. The important point to note is that continuation of the 
computation, only requires the tokens which appcared on arcs a and b. The token on arc c need not 
| propagate through the graph, and may in fact still be on arc c hen the outer M cue fires to produce an 
output and an acknowledge token, allowing the processing ofa successive set of valucs to begin. Were 
a sct of inputs to flow through the graph in this manner, removal of c's acknowledge arc would make it 
possible to reach the unsafe token configuration shown. in Figure 4.4. (The tokens are numbered to 
indicate the input set to which they belong). ‘This behavior is a consequence of T and F gate 
functioning, the foundation of the conditional construct structure. 

Understanding the analysis is aided by Figure 4.5 which gencralizes the Figure 4.4 graph to 
expose the subgraph structure. The Figure 4.4 example shows that the necessity of acknowledge arcs 
for d/a arc pairs a through ¢ is dependent on whether or not their valucs are guaranteed to be used in 
producing the outputs of the appropriate subgraph (7 or #2 of Figure 4.5). Examining subgraphs f7 
and f2, which respectively represent the inner conditional construct and multiplication operator of 
Figure 4.4, reveals that tokens arriving on arcs a, b, d, and e must be used to produce their 
corresponding output, while the need of a token arriving on arc c is dependent on the outcome of the 
inner decision operator. Therefore, c’s acknowledge arc must remain but those of arc pairs a, b, d, and 


e can be removed. 


Figure 4.5. Generalized version-of Figure 4.4 data flow graph: 


__.-. Phis analysis. specific to the conditional Construct, resiifts in csignating all input arc pairs to 
the 'ff:or f2 subgraphs subject to rulé Cl, shown in’ Figure 4.6, for determining acknowledge arc 
removal. While the rule serves to identify, and state conditions under which certain arcs within the 
conditional construct may not need acknowledges, it gives no niethiod for testing the conditions. “This 
requires a recursive look at the constructs composing subgraphs /7 and #2, the strategy just used in 
analyzing arc pairs a through ¢ in the Figure 4.4 cxaniple. ‘It is interesting to note that the analysis can 
be applied at the source level by first recognizing that subgraph /? was a conditional construct, and then 
taking the intersection of variables appearing in its then and else clauses. Variables found in the 
intersection are guaranteed to be used in producing the output of the aetiee Therefore, arcs in the 
data flow graph corresponding to these variables should not require acknowledges. 

Finally, we look at the only arc in the conditional construct of Figure 3.3 not yct analyzed -- the 
control (slashed) arc connecting a and the M gate. While the climination of acknowledge arcs within 


- our example conditional construct has been largely dependent on the existence of this controlling arc 
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Figure 4.6. Acknowledge arc removal rules for the conditional construct 


Texp] 


gh unconditional 
. Cl 


C2 


Cl: The acknowledge arc of an input arc pair to subgraph /7 or f2 may be removed if 
any token arriving on the arc must be used in producing the output of ‘the 
subgraph. 


C2: The acknowledge arc of the control arc connecting a and the M gate can be 
removed if the acknowledge arcs of the output arc pairs of the M gate has been 
removed. 


pair’s acknowledge, its presence enables the acknowledge of:an inner conditional construct’s control arc 
to be removed. The argument to justify this is the same: as that-used to explain the removal of arc g’s 


acknowledge. Consequently, in the general conditional construct the control arc between @ and the M 


gate is marked as candidate for acknowledge.are removal, and is. subject:te rule‘ C2 shown in Figure 4.6. 
This completes the analysis necessary for performing the optimization to remove unneeded 
acknowledge arcs within the conditional construct. AS a second oo we discuss the itcration 


construct for which this optimization is particularly appropriate. 
44 Analysis of the Iteration Construet 
4.4.1 Acknowledge Arc Removal 


The fact that the optimination presented in chapter 3 specifi to acy segments of a data 
flow graph, emphasizes the: significance of analyzing sie liar construct for unneeded acknowledge 
ares. Figure 4.7 shows the data flow graph transtanipn of thie VAL itcration expression: 

for idlist = expde iterbody ead 
The function of this construct: Sto + evaluate exp and then — iterbody, which outputs an iter? 
control value and a set of data Suites ft ous its I (iteration) er: a (return) output arcs, depending 
respectively on whether the iter? output valuc is true or false. succesiive evaluations of iterbody are 
made until a falc. iter? value 1 is ioe! at whet time Svaluao of ihe: construct with a new set of 
oe en F : 

The function of the ifer? arc is to Panes the conn! value to D the group of M gates which 
present successive sets dina te the siraiscgs boxy. The arc is: 5 intiabiced with a flee control value to 
ensure proper selection of the first set of data values. Assuming that the iter? ani is dependent on at: 
least some of the M gate inputs, a number of them. must fire before a second iter? valuc. is produced. 
This necessarily implics.the firing of. copy operator "L" in Figure 4.7, to present the M-gates: with iter? 
control inputs needed to enable them -- conscquently ensuring that the jer? output arc of iterbody must 


-be empty: for a successive ifer? value to'be produced. As a result,.the acknowledge are of this-arc pair 


-67- 


Figure 4.7, Acknowledge arc removal rules for the intcration construct 


iter? unconditional 
Gj ae; Wana ra 
¥ apg 


Tl: The acknowledge arc for an arc pair between operator L and the sequence of M 
gates can be removed if its data value must be used in producing the iter? value. 


T2: The acknowledge arc of an I (iteration) arc pair can be removed if either 
(1) The iteration body cannot emit a valuc on that output arc until it has — 
absorbed the corresponding input value on the corresponding input arc. 
(2) The iter? value depends on the corresponding input arc. 


T3: The acknowledge arc of a v, arc pair can be removed if the arc pair is not input to 
aT, or F gate, and the iter? output value of iterbody depends on the v; arc value. 


(between iferbody and 1.) can be remeved. 

No such guarantee can be madc for the arcs between copy operator L and the M gates, since 
the iter? valuc need not be a function of every M gate input This implics the possibility of producing a 
second iter? value before every instance of the previous iter? z ves specarine on the arc pairs between L 
and the M gates has been absorbed. Should: L. fire, unconditional femoval of the acknowledge arcs of 
these arc pairs could cause a conflict. Consequenty acknowl arcs of these arc pairs are marked as 
conditionally removable subject to rule T1, specified below Figut 4.7: M gates whose data value 
inputs arc used in producing the iter? control ‘viloe ust firé \Gborbing the current iter? value, their 
control input) before a successive iter? value Isprodtuced, aiid consequently need no acknowledge arcs. 

Examining the form of the itcration Sanus a is a necessary preliminary to 
determining acknowledge arc rentovel = the remaining arc pairs in the itcrative graph. Since the 
function of the construct is to iterate or r return a set of values based ¢ an some boolean function, iterbody 
must contain a conditional. The BNF dpecifiation of VAL confirms this via the production: 

iterbody ::= if exp then iterbody, cise iterbody, end 

Figure 4.8 shows the data flow. graph translation of this conditional iteration body. Graph inputs are 
respectively presented to the subgraph representing cither iterbody, or iterbody, via T, or F gates, as a 
result of evaluating exp. The sclected subgraph will produce a set of outputs at either its I (iteration) or. 
R (return) output ports according to its iter? output value: true for 1 outputs: false for R outputs. The 
iter? output values of the iteration body subgraphé, along with the output of the predicate subgraph, 
exp, are the inputs to the Ic gate which controls the graph output ports ‘The ic gate has three outputs: 
A graph iter?, and an I control alte and R control value which provide control inputs to two scts of M 


gates respectively merging the I and R data outputs of the iteration body subgraphs to produce graph 


outputs. A more detailed spccification of the IC gate is given in Table 4.1. Functioning. of the 
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Figure 4.8. T lif exp then iterbady, else iterbody, end] | 


Table 4.1. Functioning of the IC gate. 


predicate Tyliteration;], Ty fiterationy] graph on R 
control iter? iter? iter? control — control 
true true == true true ad 

true false = false - true 
false = true true . false a 

false o false false ad false 


error - -- false - : error 


conditional iteration body is secn through several cxamples presented in section 4.4.2. 
By replacing iterbody in the Figure 4.7 graph of the iteration construct with the Figure 4,8 
conditional iteration body to produce Figure 4.9, the.I output arcs of the iteration construct can be 


analyzed for acknowledge arc removal. 


Figure 4.9. Iterative data flow graph containing #erbody subgraph of Figure 48° 


Recall that a set of output valucs should appear on the I arcs for cach true ifer? value produced. 
The acknowledge arc of a particular I output arc may be removed if either of two conditions is satisfied. 
The first is the:case in which production of the output valuc is dependent on the corresponding input 
value; appearance of a ncw. value implies absorption of the previous value. At first glance this would 
‘seem to occur always. In fact, it is possible to produce a second eutput on some I arc without using the 
previous value, as is seen in the example in scction 4.4.2. The second condition under which an I 


acknowledge arc can be removed is dependence of the iter? value on the corresponding I input. 
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To understand this we look at the. IC gaté: in Figure 4.9; one-of : whose outpitt' arcs is iter?. 
Firing the IC a will produce values on two of its three pute arcs; the -ifer? arc and cither the 
iteration or return control arcs which respectively arouils contr input values for M giles connected to 
the graph I and R output i parts “Until the IC gate Fires thse M gates wll not be enabled. A set of 
valucs appearing on the graph | output ports therefore’ redutres the bilor IC gate firing to produce the 
M gate control values, as well as an iter? value. It is clear eg if a ister? valuc is dependent on a 
particular : are input value: that I arc must be py: ak it or receive a one iteration value. 
Consequently aanow eck arcs of I arc pairs s sain this mllere dependene are not necded. The two 
conditions under which Oe acknowledge arc of an I arc sy can be aptatare are summarized in rule 
T2, of soe q | 

To onipleie analysis of the iteration actos we deci the input arc pairs | to the iteration 
body! labelled Vis in peu 4.7. seas for aKiowinse arc removal must be done individually for 
each vj scording to the following guidelines If the arc pair is put toa T, or F Bate, ae acknowledge 
arc must remain: This follows from the cecusion of T and F gate behavior. Hf the arc pair is input to a 
functional operaton or M gate, the e acknowledge arc can be removed l a ihe iter? outa of the iterbody is 
dependent on the v; arc value. The v; arc pairs are outputs cet a set of M gates controlled by the graph 
iter? value. In order to remove ime acknowledge are ofa cee V; arc pair, it is not sufficient that. 
the v; aie be necded in computing a successive i itcrative value in es aha to a true iler? output. The 
v; value must also have been used coos a new input value resulting from a false iter? value appears. 


This is ensured if iter? depends on the Vi value. Rule T3 shown in im ou 4. 7 states the acknowledge arc 


removal rule + for the v; arc pairs. 


44.2 Acknowledge Are Removal in-Herative Programs .. 


To apply ¢ the acknowledge arc eval rules eves in the previous section, we oo with 
the simpic but familiar factorial algorithm expressed as the flowing VAL program: | - 
Siu=hle _ 
fi gntheniterit Ly*icdseyend =. . 
end 
The data flow sraph repResreMion of this | program is sum in a Figure 4 10. The prank is composed of 
an iteration construct whose terbody isa simplified ‘ire of the conditional it iteration bag abies shown 
in Figur 4 4 8. The simplification o oceurs since ‘only the then claus of he conditional i itcration body will 
: actually iterate values. Though both branches have the ability to iterate and return vals, the tal 


‘ 


recursive structure of the algorithm causes values to be itcrated ue one branch and returned 


Boa DouFEE Yen ted, 


through the other 


Ifa set or rules existed for each VAL construct determining which hn acknowledge a arcs to remove 


for the fectovia data flow graph would begin with ees of th the i inner ‘conditional iteration m body. 
However: since we have aly developed rules: for the conditional and etn con constructs, + we must 
keave the condinions} itcration ‘octy as.is, sad prance to the surrounding iteration construct. | 
Clearly, the ateowicie: arc between the IC = ad operator Le can ‘be réascieds Rule Tl 
eovetia did are pairs between cai Migee The and data values must be used in producing 
the iter? control valuc; ihereford: only the acknowledge: arcs of the arc pais 5 between L aa the M gates 
sdnvallie the i and n data values may be removed. 1, D, and B (eeraion) arc pairs satis the first 
condition of rule T2; a successive value cannot be peudliced’s on n the i output arc > until the corresponding 
input value on the corresponding input arc has been absorbed. Thus, 1 none of shes needs an 
acknowledge arc. Finally, we examine the v; arc pairs, which in the Figure 4.10 graph represent all six 


-afc paifs cmanating from the three M gates controlling the i, y and a data values. According to rule T3, 
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only the two arc paifs inpet te the predicate of the conditional iteration body can have their 


acknowledge arcs removed. The other four are input to 'F and.F gates, making their. acknowledge arcs 
essential. The results of this analysis are shown in Figure 4.11 where each arc requiring an acknowledge 
arc has been marked with a double bar r those not ‘iitked are eel to be single data arcs. 

While the factorial data flow graph shown in: Figure Alois produced by the T algorithm, the 
simplified form of the conditional iteration body is ike atin a the M gates which merge iteration 
and return values of the conan though arene ie no Simin The reaiatigt is to optimize the 
graph by removing these M gates as well as the-IC gate I and R controloutputs. Though possible, rule 
T2 must be reevaluated as a ditcct consequcnec of this action since the analysis used to formulate rule 


T2 relies on the standard form of.the conditional iteration body shown in Figure 4.8. Spccifically,: the 


7) 


Figure 4.1 1. Optimized factorial data flow graph: 


reasoning behind.casc (2) of ruic:T2 is dependent on the presence of the band RM gates. We state rule 


T2. and proceed to reexamine cach of its cases. 


T2: The acknowledge arc of an | arc pair can be removed if either: 
(1) The iteration body cannot emit a valuc on that output arc 
until it has absorbed: the corresponding input Value on the 
corresponding input arc. 


(2) The iter? value depends on the corresponding input arc. 
Condition (1) of this rule still applies, since it: describes the situation in which each successive — 
itcration value is a function of its previous value. Cicarly, only one value can appear on an arc which 


-Satisfics this condition at any time. Removing the M gates dees not-affect this case. ‘To reevaluate case 
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(2) of rule 1. we focus on the data flow graph shown in Figure 4.12, the representation of the VAL 


program: 
fori, y = 1, ldo 
if i < n then iter y+1, i+2 else y end 
end 
This graph, similar in structure to the factorial.graph, displays the same M gate phcnomenon, but is 


significant in its reassignment of iteration variables. Each of these two variables is a.function.of the 


other: Iteration variable i is a function of y, and iteration variable y is a function of i. 


Figure 4.12.. Example data flow program 
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Iteration arcs of the factorial data flow graph satisfied case (1) ef rule T2 - dependence of a 
successive value on.its previous value, allowing their acknowledge arcs to be removed. Case (1) does 
not apply to the [Il and 12 arc pare in ie graph i in rieore 4. 2 due to the “erossover" reassignment of 
iteration. variables. However, their acknowledge arcs can She avel since casc (2) of rule T2 is 
satisfied: Production of the ifer? value depends.on both tand y. Variable fit nceded toi compute the IC 
gate control input, and variable y ‘generates the gatc’s truc data input. - 

The structure of the Figure 4:12 data flow graph’ enables us to examine whether case (2)-of rule. 
T2 correctly determines acknowledge arc removal if the graph is optimized by removing its I and R M 
gates and IC output control arcs (portion of the graph shown in the dashed box). Consider the state of 
the graph shown in Figure 4.13, the optimized version of the Figuré 4.12 graph. 

| It is now possible for a sequence of operator firings to place a successive vac on 12, resulting 
in the unsafe state shown in Figure 4.14. Even though the IC gate is dependent on the y value, the 
production of successive iteration ae is no longer ‘dependent on the prior firing of the IC gate. 
Thus, the i value can pidpagate through the graph to produot'a Sucnesive y value before the previous y 
value has been absorbed. We sce that as a result Fe optimizing the standard graph form, the case (2) 
condition is no longer adequate for ensuring safe removal Of itcratio# acknowledge arcs. 

One approach to this orbital is to speci this type of graph optimization as illegal. Such a 
restriction favors the sail of i iteration acknowledge acs over the removal of unnecessary operators. 
At the same time, it cnables uniform application of the present acknowledge arc removal rule. A 
second approach involves redefining rule T2 for optimized graphs whos¢ M gatcs have been 
eliminated. Removal afT acknowedige arcs bécomce deerident on the predicate value sather than the 
iter? value. The functioning of the graph dictates that data used in criiating 1 or R values must come 


through the T or F gates controlled by the graph predicate. This ensures that M gates controlling 


Figure 4.13. Modified data flow program from Figure 4.12 


variables ‘used in computing the predicate must fire before new iteration values can be produced. “Fhe 
modified version of rule 'f2, case €2): reflects: this analysis by spccifying that-an-iteration acknowledge 


arc may be removed if its corresponding input arc must be-used in producing’ the predicatc'value. 


T2: The acknowledge arc of an I arc pair can be removed if 


(1) The iteration body cannot emit a value on that output arc 
until it has absorbed the corresponding input valuc:on the 
corresponding input arc. 


(2) the predicate output value depends on the corresponding 
imputar, LGeaue Sean) alae 


Figure 4.14. Unsafe token configuratioa for Figure 4.13 - 


Using this rule, the acknowledge arc of iteration arc pair 12 can ret be removed since computation of 
the predicate valuc docs not involve y, the variable contmlled by its corresponding input arc. 

This analysis of the factorial algorithm, cmphasizes the aptions and problems which quickly 
surface in considering rather basic examples. ‘The acknowledge arc removal rules, while adequate for 
graph configurations derived by a ighifeewadiy apelin the T siesitim: Cala suite significant 
expansion mn be anual sed with ov pairs 2A. Study. ask complex graphs or of 
those requiring this optimization in conjunction with vaiher éotimbations would be useful in 
determining the general applicability of ee fice aad is pete as aa area of interest for future 


research. 


CHAPTER FIVE 
5.1 Summary 


The aim of this thesis has been to address problems which arise in.translating a high level 
language for a machine architecture designed for paratiel processing. While the high level language is 
nearly indistinguishable from source languages. ‘for standard scquential processors, the dala driven 
execution of its instructions requires a radically. different form of translation. This study-of data flow 
translation uses the high level language VAL and. the Dennis-Misunas. architecture. While standard 
methods of data flow processing do not yet exist, the model used: reflects the typ¢ of translation issues to 
be tackicd. in the realm of data flow. The problems unveiled and sohutions proposed are illustrated 
using data flow graphs;-which result-from applying, the’ translation: algorithm: to VAL programs. 
Though these data flow graphs closely correspond to. the machine ‘anguage ‘representation of VAL 
programs, their level of abstraction and explicit ‘represention ‘of data dependencies make them a 
gencrally accepted model of data flow. - 

Chapter 2 focuses on-the firing behavior of data flow graph operators which must ensure a 
‘maximum capacity of one value per arc as dictated by the Dennis-Misunas architecture. While 
restrictions of other data flow architectures may be less severe, the need to place some finite limit on arc 
capacity is common to most. The transformation of ares within data flew graphs to data/acknowledge 
arc pairs 4s introduced as a means of implementing the desired operator behavier. A formal argument 
establishes that the safe operation resulting. from the transformation is guaranteed, and that the liveness 
and functionality of the graph:is not altered. The use of data/acknowledge arc pairs does however have 
a profound effect on operator firing sequences within a given graph, and therefore on its throughput. 


The remainder of the thesis explores the consequences of incorporating d/a arc pairs and suggests - 


methods of modifying the transformation algorithm: to impro¥e graph performance. 
Though safe operation is achieved by pieventing any given operator from firing until 
appropriate acknowledges are reccived, the delayed firing of an operator may cause a epee and 
“unnecessary delay. to:operators dependent on its output. This phenomenon is the subject of chapter 3. 
‘The algorithm developed ia this chapter climinates potential: bottlenecks within a graph by buffering 
arcs with ‘identity operators:so: that all:paths through the graph are am cqual.Jength: Analyses of 
performance shew that this approach maximizes throughput, -but ata potentially high cost in: terms of 
identity. operations.. While performance: statistics: indicate . that. this latter ‘strategy. ‘is promising, the 
choice of an:optimum buffering sckieme is complicated by the-numbce of interacting factors. - 

‘A second approach: for: optimizing .a transfonmed:data flow graph, which aims to decrease 
_everhead by climinating. uanceded acknowledge: atcs,. is:discussed in-chapier.4. -By identifying 
situations: in- which. particular. arcs: de rot depend ion.ap acknewledgement to prevent multiple token 
occurances, the number of acknowledge arcs.can be mihimized.. This is accomplished by analyzing the 
data flow graph implementation of cach VAL construct to find. are pairs that: may:be subject to 
acknowledge arc removal, and. specifying’ rules which enable these situations to be rocagnized. The 
chaptcr concludes with several examples illustrating. this uptimization. :While the: techniques of 
balancing token flow and removing unnecessary acknowledge arcs have been. developed independently, 
the optimum..configuration for any given data flow graph a reached. by. application of both 
optimizations. The absence of specific information: about hardwarc (c.g. operator execution times, ctc.), 
prevents the develepment of an algoritam combining the two at this time;: however, aa attempt is made 
to identify the major factors contributing to the choice of optimizations. .Fhese issucs <cveloped in 
chapters 3 and 4 should prove applicable to translation and optimization problems arising in other data 
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5.2 Directions for Future Research 


Three areas of research are natural extensions of the work presented. The first facia on 

further development of the chapter 4 optimization. The saa uceiind analyeed the VAL. conditional 
and aii constructs to determine the circumstances under which eon arc pairs could safely 
function without an acknowledge arc. A more extensive giity ok data flow graphs ens these 
constructs would be useful in dceantniie the completeness of the ‘hes oa: Certain raph 
configurations may reveal additional cases to test for in removing acknowledge arcs, thus oats to an 
extension of the proposed rules. A more straightforward task involves application of the chapter 4 
analysis to the remaining VAL constructs. This work is required for the development of a recursive 
algorithm which could perform acknowledge arc removal for the data flow graph representation of a 
program. 

A second avenue of research centers on performance evaluation of data flow graphs. As data 
flow computcr prototypes become available, the type of performance analysis shown in chapter 3 
should produce more accurate data. Statistical studics can be made of token flow patterns for various 
graph configurations, and corresponding optimization schemes. Information gathered should 
determine when or whether the benefits of an optimized graph outweigh the cost incurred. A study of 
different configurations of a single ‘ita flow graph should provide valuable data on optimization 
tradcoffs. This would contribute invaluable information toward formulating an algorithm integrating 
the optimizations of chapters 3 and 4. 

Finally, the rescarch can be extended to include more traditional optimization techniques. 
This would initially require a determination of which of these optimization strategies are applicable 
and adaptable to data flow. While redefining optimizations such as strength reduction seems possible 


and fairly straightforward, the adaptation of other traditional optimizations to a parallel processing 


context may require a different set of considerations. A data.flow-version of these optimizations could 
depend on the development of certain tools, such as a categorization of cquivalent graph 
Snnginaione A comprhieaave examination of the seatication and meaning of such traditional 
optimizations in data flow reusing The potential ‘A following this route, aad ar further developing 
dpdmimatons particular to data flow computation idee beginning to be saaced: The extensive history 
of sequential programming optimization seis will no acubs have its countegpart in the world of 


data flow. 


fl] 


P2] 


{3} 


[4] . 


[6] 


7} 


[8] 


[9] 


[10] 


[]}- 


-33- 


BIBLIOGRAPHY 


Ackennan, W. B., “Interconnections of Determinate Systems", Computation Structures: Group 
(Note 31), Laboratory for Computer Science, MIT, Cambridge, Massachusetts, July 1977. 


Ackerman,-W.B., and J.B. Dennis, VAL -- A  Vatue-Oriented Algorithmic Language: 
Preliminary Reference Manual, Laboratory ‘for Computer Science a R-218), MIT, Cambridge, 
Massachusctts, June 1979.- 


Brock, J: D., Operational Semantics of a Data Flow Language, Laboratory for praia Science 
(TM -120), MIT, Cambridge, Massachusetts, December 1978. 


Brock, J.D., .and L.B. Montz, “Translation: and’ Optimization of Data Flow Programs"; 
Proceedings of the 1979 International Conference on Paratlel Processing (O: N. Garcia, Ed.), 
August 1979, 46-54. Also, Computation Structures Group (Memo 181), ano for 
Computer Science, MIT, Cambridge, Massachusetts. 


Chamberlin, D. D.., “The *Single-Assignment’ Approach to Parallel Processing", AFIPS 
Conference. nee 39, ae Fall Joint EEC OREN, Peace 1971, 263 “269. 


Commoner, F., "Deadlocks in Petri Nets”, Reseaik Report of Applied Data Research, Inc., 
Lakeside aah Paik, Wakefield, Mass., June: iio 


“Commoner, F., << Evin, A Ww. Holt,. and. A. Priveli,; "Marked Direct | Graphs", 


Journal of C omputer and System Sciences 5, October 1975, SH a2 


Denning, P. I, "On the Determiltiaey of Schemata”, Record. of the Pract MAC Coidenence on 
Concurrent ae and eral’ C ai ide ACM, New tor, 1970, 143- st 


Dennis, J. B., “First Version of a Data Flow: Preceding ae -Progranuning Symposium: 
Proceedings, Colloque sur la Programmation (B.Robinet, Ed.), Lecture Notes in Computer 
Science 19, 1974, 362-376. Also, Laboratory for. eer —— saciid on. MIT, ea 


' Massachusetts. — 


Dennis, J. B., "A Language Design for Structured Coneurrency",.Design and Implementation of 
Programming Languages: -Proceedings of a DoD Sponsored’ Workshop (J.H..Williams and 
D. A. Fisher, Eds.), Lecture Notes in Computer Science 54, October 1976. Also, Computation 
Structures. Group’ (ete 28-1), Laboratory for: Computer -Science,.. MIT; Cambridge, 
Massachusetts. oa “tee et, Sie. 2 


Dennis, J. B., and‘D. P. Misunas, "A Preliminary Architecture for a:-Basic Data-Flow Processor", 
The Second Annual Symposium on Computer Architecture: Conference Proceedings, 
January 1975, 126-132. Also, Computation Structures Group (Memo 102), Laboratory for 


Computer Science, MIT, Cambridge, Massachusetts. 


[12] 


{13] 


[14] 
{15} 


[16] 


{17] 


[18] 


Dennis, J. B., D. P. Misunas, and C, K. C.Leding, “A ‘Highly Parallel Processor Using a Data 
Flow Machine Language”, Computation Structures Group (Mcmo 134-1), Laboratory for 
Computer Science, MIT, pied ee June 1979. To meee in IEEE 


hasta cakcles atone 


Dennis, J. B., and K.-S. Weng, "An Abstract fdplonce tins for Cocurrest Conputatiog with 
Streams”, Proceedings of the . 1979 - International: Gonference: on. Parallel - Processing 
(O..N. Garcia, Ed.); August 1979; 35-45) ‘Also; Computation: Structures: —— ee 180), 
Laboratory for Computer Science, MIT, Cambridgc, Massachuse@tzi 


Hack, M., Analysis: of Production Schemata by’ Petei: Nets; spicy ie meruaeh Bcienae 
(TR-94), MIT, Cambridge, Massechusetts, February 1972, fii 


Holt, A. W., Final Report of the Informations System. Theory Project, Technical Report 
BADE Te noes Air acer Ones cians nies Base, New hae 1968. 


Holt, A. W., ae F. Einninneck "Events: and: Conditions”. cued: we the: Project MAC 


C shied on n Concurrent S oie oe paale bee acci —_ New ve HN, hes 


Ae it, adc aeen. Ce eadind ‘Solutions of Laplace's: Equation”, Computation 


Structures Group. (Note 37), pasaease a peal Science, MIT. eras 
Massachusetts, nly 1978; = wv ofp nae y ai 


Karp, R. M., and R. E. Miller, oe Ws vi pati asin Diescrniinacy, 


.. Termination, Queueing”, Sai eres * sc gaa aRerOnan lila Neat 1599-1411, 


{19} 


{20} 


(21) 


(22) 


[23] 


i ea YT af. ne RR 


Kesscls, J. L. W., “Parallel Programming Coneepe i in a Defintional 1 Language” ‘SIGPLAN 
Notices, Be ee a Te he out Re eso, 
‘ as ?; 


Kosinski, P. R., A Data Flow Pie Langue 10M 1 T. 1 . Watson Research Center we 


ee ee mal ete yee Ae. 4 
Kosinsti,P. R., siinds Fie Vaasa 4s Gea Gata anes Proceedings of 


ACM SIGPLAN-SIGOPS Interface Meetings, SIGPLAN Notices 8, X\September:4973); 89-94. 


‘Leung,-C. K.C., Formal’ Properties of Well-Parmed: Rata -Blaw Schemas, ecu ‘for 


bps jaja aac aap anv acaniniten i ponents ore Cote ibaa ed 


Leung, C. K.C., De. Misunas: A: Noeawid-aad J: B: Dennis, “A Computer Sinvulaion Facility 
for Packet Communication Architecture", The Third Annual Symposuet-on .Gemputer 
Architecture, Computer Architecture News 4, 4(January 1979), 58-63. Also, Computation 


_ Structurés Group. — een ee sama alike pits: 
—_— 


[24] 


[25] 


[26] 


[27] 


[28] 


[29] 


- 85- 


Misunas, D. P., “Deadlock Avoidance in Data-Flow Architecture", Proceedings of the Third 
Milwaukee Symposium on Automatic Computation and Control, April 1975. Also, Computation 
Structures Group (Memo 116), Laboratory for Computer Science, MIT, Cambridge, 
Massachusetts. — 


Patil, S.S., “Closure Properties of Interconnections of Determinate Systems", Record of the 
Project MAC Conference on Concurrent Systems and Parallel Computation, 1970, 107-116. 


-Petri,C. A... Communication with Automata, Supplement 1 to ‘Technical Report 


RADC-TR-65-377, Vol. 1, Griffiss Air Force Base, New York 1966. [Originally published in 
German: Kommunikation mit Automaten, University of Bonn, 1962.] 


Ramchandani, C., Analysis of Asynchronous Concurrent Systems by Petri Nets, Laboratory for 
Computer Science (TR-120), MIT, Cambridge, Massachusetts, February 1974. 


Tesler, L. G., and H. J. Enea, “A Language Design for Concurrent Processes", Proceedings of the 
AFIPS Conference 32, 1968, 403-408. 


Weng, K.-S., Stream-Oriented Computation in Recursive Data Flow Schemas, Laboratory for 
Computer Science (TM-68), MIT, Cambridge, Massachusetts, October 1975. 


